00000001:02000400:1.0F:1787856507.126662:0:3297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_hostid 00000001:02000400:1.0:1787856515.903171:0:3500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1787856516.931411:0:3563:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1315 MB/s 00000001:01000000:1.0:1787856517.181423:0:3563:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1571 MB/s 00000001:01000000:1.0:1787856517.431287:0:3563:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10327 MB/s 00000020:02000000:1.0:1787856517.738328:0:3592:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_81_g80478ec 00000400:02000000:2.0F:1787856518.112443:0:3607:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.106@tcp [8/256/0/180] 00008000:02000000:2.0:1787856520.504789:0:3756:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787856580.434449:0:5723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1787856594.644083:0:6473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787856594.644101:0:6473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787856594.644103:0:6473:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787856594.644269:0:6473:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003dbd70aa 00000080:02000400:3.0:1787856594.644280:0:6473:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787856594.653797:0:6473:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787856594.653812:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787856594.653847:0:6473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000bedc1926) 00000020:00000080:3.0:1787856594.653869:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787856594.755326:0:6473:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787856594.755428:0:6473:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787856594.778844:0:6473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787856594.779401:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787856594.779411:0:6473:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787856594.779424:0:6473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c3548 00000020:01000004:2.0:1787856594.779431:0:6473:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787856594.779436:0:6473:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787856594.779440:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003dbd70aa from MGS 00000020:01000004:2.0:1787856594.779445:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787856594.779471:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001375f7f9) 00000020:00000080:2.0:1787856594.779482:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787856594.779595:0:6473:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003dbd70aa from MGS, refs=2 00080000:01000000:2.0:1787856594.779601:0:6473:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787856594.779606:0:6473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c3556 00000100:00100000:2.0:1787856594.779700:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787856594.780657:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787856594.780664:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787856594.781579:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787856594.781586:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787856594.782571:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787856594.782766:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787856594.782772:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787856594.783674:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787856594.783683:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787856594.784444:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787856594.784452:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0F:1787856594.785844:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856594.785856:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856594.785858:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856594.786593:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856594.786596:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856594.786598:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856594.787697:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787856594.792929:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787856595.039298:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3730 MB/s 00000001:01000000:2.0:1787856595.289329:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4203 MB/s 00000001:01000000:1.0:1787856595.540188:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 511 MB/s 00000001:01000000:2.0:1787856595.789867:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 659 MB/s 00010000:00010000:3.0:1787856595.793438:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787856595.799107:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1787856595.812492:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787856595.813130:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787856595.813175:0:6473:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787856595.813206:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787856595.813374:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787856595.813406:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787856595.813696:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787856595.813865:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787856595.813873:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787856595.823129:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787856595.823148:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787856595.823713:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787856595.823721:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787856595.831485:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787856595.831520:0:6473:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.106@tcp' 00000020:01000004:0.0:1787856595.831522:0:6473:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787856595.831578:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.106@tcp (typ=mgc) 00000020:00000080:0.0:1787856595.831608:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.106@tcp (0000000033d6430e) 00000020:00000080:0.0:1787856595.831626:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787856595.831756:0:6473:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d63d0101@MGC192.168.202.106@tcp: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1787856595.833922:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.106@tcp-0 is initialized 00000040:01000000:0.0:1787856595.833935:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787856595.839540:0:6493:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787856595.839629:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.106@tcp (uuid c911024a-9030-4ea8-a782-9255ee9580a7) 00000020:00000080:1.0:1787856595.839671:0:6473:0:(genops.c:1385:class_connect()) connect: client c911024a-9030-4ea8-a782-9255ee9580a7, cookie 0xc25410d92a3c3564 00000100:00080000:1.0:1787856595.839683:0:6473:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856595.839690:0:6473:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import 00000000d63d0101 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856595.839721:0:6473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007cf438ad x1874703436218496/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856595.839742:0:6473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c911024a-9030-4ea8-a782-9255ee9580a7->MGS 00000020:01000004:1.0:1787856595.839762:0:6473:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787856595.839767:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:0.0:1787856595.839932:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c911024a-9030-4ea8-a782-9255ee9580a7:3622:1874703436218496:0@lo:250: 00000100:00100000:0.0:1787856595.840042:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856595.840109:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436218496 00000100:00100000:0.0:1787856595.840114:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436218496 00000100:00100000:0.0:1787856595.840138:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787856595.840144:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063db4e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1874703436218496:12345-0@lo:250: 00000100:00080000:2.0:1787856595.840353:0:6492:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787856595.842366:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000337dc46a) 00000020:00000080:1.0:1787856595.842485:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00080000:0.0:1787856595.843505:0:6488:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from c911024a-9030-4ea8-a782-9255ee9580a7@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:0.0:1787856595.843538:0:6488:0:(genops.c:1385:class_connect()) connect: client c911024a-9030-4ea8-a782-9255ee9580a7, cookie 0xc25410d92a3c3572 00000100:00080000:0.0:1787856595.843665:0:6488:0:(import.c:65:import_set_state_nolock()) 00000000ac9108f3 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856595.843755:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063db4e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+5:3622:x1874703436218496:12345-0@lo:250: Request processed in 3609us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856595.843764:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787856595.845318:0:3622:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787856595.845332:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1787856595.845341:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787856595.845346:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787856595.845364:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000d63d0101 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787856595.845367:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787856595.845451:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787856595.845459:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c911024a-9030-4ea8-a782-9255ee9580a7:3622:1874703436218496:0@lo:250: 00000100:00100000:0.0:1787856595.863199:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787856595.863693:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787856595.863700:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787856595.866542:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787856595.866668:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787856595.867987:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787856595.867998:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787856595.868855:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787856595.869040:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787856595.869049:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787856595.870008:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787856595.870015:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787856595.910970:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787856595.911305:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787856595.911313:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787856595.912756:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787856595.912769:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787856595.913462:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787856595.913636:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787856595.913641:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787856595.915050:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787856595.915067:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787856595.919513:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787856595.919729:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787856595.919747:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787856595.920666:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787856595.920676:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787856595.923147:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787856595.923705:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787856595.923712:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787856595.928414:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787856595.928431:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787856595.963700:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787856595.963940:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787856595.963962:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787856595.973991:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787856595.974008:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787856595.975720:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787856595.975898:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787856595.977753:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787856595.977791:0:6473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787856595.977798:0:6473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787856595.977896:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787856595.977927:0:6473:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787856595.977932:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787856595.977934:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856595.977935:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856595.977936:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856595.977938:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856595.977939:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856595.977952:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856595.977955:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787856595.977957:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856595.977958:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856595.977960:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856595.977961:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787856595.977964:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787856595.977966:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787856595.977968:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856595.977969:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856595.977970:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856595.977971:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856595.977971:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856595.977972:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856595.977973:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787856595.977974:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856595.977975:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856595.977976:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856595.977977:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787856595.978002:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787856595.978019:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad2724e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436218624:0@lo:253: 00000100:00100000:2.0:1787856595.978103:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856595.978173:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b87972 going to sleep for 11 seconds 00000100:00100000:3.0:1787856595.978306:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436218624 00000100:00100000:3.0:1787856595.978312:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436218624 00000100:00100000:3.0:1787856595.978358:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787856595.978366:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa389612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+5:6473:x1874703436218624:12345-0@lo:253: 20000000:01000000:3.0:1787856595.978411:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787856595.978414:0:6491:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787856595.978855:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787856595.978896:0:6491:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787856595.979149:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856595.980541:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787856595.980844:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787856595.980849:0:6491:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787856595.980855:0:6491:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787856595.980869:0:6491:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787856595.980882:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787856595.981094:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856595.981658:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787856595.981677:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787856595.981697:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787856595.981711:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787856595.981725:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787856595.981781:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787856595.981789:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787856595.981802:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787856595.981807:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787856595.981819:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787856595.981824:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787856595.981836:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787856595.981848:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787856595.981873:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787856595.981878:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787856595.981884:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856595.981984:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787856595.981994:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787856595.982008:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787856595.982022:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787856595.982035:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787856595.982043:0:6491:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787856595.982065:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787856595.982072:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787856595.982084:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787856595.982098:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787856595.982110:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787856595.982117:0:6491:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787856595.982136:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787856595.982151:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787856595.982710:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787856595.983001:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787856595.983068:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787856595.983088:0:6491:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787856595.983095:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787856595.984513:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787856595.984924:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787856595.984959:0:6491:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.106@tcp for mdt 20000000:01000000:2.0:1787856595.984961:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:2.0:1787856595.984977:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787856595.984984:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787856595.984997:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787856595.985001:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:2.0:1787856595.985014:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787856595.985021:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787856595.985032:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787856595.985046:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787856595.985072:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787856595.985075:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787856595.985079:0:6491:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787856595.985133:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787856595.985135:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787856595.985962:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787856595.986144:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787856595.986372:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787856595.986462:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787856595.986476:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787856595.986478:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787856595.986714:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787856595.987022:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787856595.987041:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787856595.987054:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1787856595.987063:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787856595.987072:0:6491:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787856595.987077:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787856595.987079:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787856595.987084:0:6491:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787856595.987090:0:6491:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787856595.987547:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787856595.987657:0:6491:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787856596.002445:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787856596.002482:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787856596.002496:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787856596.002516:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787856596.002537:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002553:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002563:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002569:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002576:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002582:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002588:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6e2ae77 already unused, calling callback (00000000c3795dd1) 00010000:00010000:2.0:1787856596.002592:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002615:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002628:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002634:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.002639:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c6e2ae77/0xc25410d92a3c3579 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787856596.002655:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787856596.017975:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa389612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+5:6473:x1874703436218624:12345-0@lo:253: Request processed in 39601us (39863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.017998:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856596.018395:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad2724e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436218624:0@lo:253: 10000000:01000000:0.0:1787856596.018411:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787856596.018415:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787856596.018416:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787856596.018418:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856596.018419:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787856596.018420:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856596.018421:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856596.018422:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787856596.018424:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787856596.018425:0:6473:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787856596.018427:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856596.018428:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787856596.018449:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003dbd70aa from lustre-MDT0000 10000000:01000000:0.0:1787856596.018503:0:6473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787856596.018506:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787856596.018510:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9065e9fd0000 10000000:01000000:0.0:1787856596.018515:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787856596.018522:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9065e9fd0000 from 1 10000000:01000000:0.0:1787856596.018525:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787856596.018564:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856596.018574:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856596.018582:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856596.018607:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011bc5800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436218752:0@lo:101: 00000100:00100000:0.0:1787856596.018642:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.018691:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae463bb4 going to sleep for 11 seconds 00000100:00100000:1.0:1787856596.018761:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436218752 00000100:00100000:1.0:1787856596.018767:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436218752 00000100:00100000:1.0:1787856596.019289:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856596.019300:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aec5b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+5:6473:x1874703436218752:12345-0@lo:101: 00010000:00010000:1.0:1787856596.019314:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856596.019326:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3580 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.019347:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.019355:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.019363:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005218be24, rc 0) 00000100:00100000:1.0:1787856596.019395:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aec5b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+6:6473:x1874703436218752:12345-0@lo:101: Request processed in 99us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856596.019448:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011bc5800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436218752:0@lo:101: 00010000:00010000:0.0:1787856596.019460:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856596.019468:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856596.019528:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011bc5800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436218880:0@lo:501: 00000100:00100000:0.0:1787856596.019552:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.019575:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae463bb4 going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.019675:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436218880 00000100:00100000:2.0:1787856596.019680:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436218880 00000100:00100000:2.0:1787856596.019700:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856596.019706:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb06113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+7:6473:x1874703436218880:12345-0@lo:501: 00000100:00100000:1.0:1787856596.019861:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787856596.020288:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb06113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+6:6473:x1874703436218880:12345-0@lo:501: Request processed in 581us (734us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787856596.020295:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856596.020446:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011bc5800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436218880:0@lo:501: 10000000:01000000:2.0:1787856596.020554:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787856596.020603:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.020613:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856596.020629:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9065d3be8000 10000000:01000000:2.0:1787856596.020634:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787856596.020638:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9065d3be8000 10000000:01000000:2.0:1787856596.020640:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787856596.020643:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9065d3be8000 from 1 10000000:01000000:2.0:1787856596.020646:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787856596.020667:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000c6e2ae77/0xc25410d92a3c358e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.020673:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000c6e2ae77/0xc25410d92a3c358e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.020682:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000c6e2ae77/0xc25410d92a3c358e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856596.020695:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219008:0@lo:101: 00000100:00100000:2.0:1787856596.020722:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856596.020797:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b87972 going to sleep for 11 seconds 00000100:00100000:1.0:1787856596.021247:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436219008 00000100:00100000:1.0:1787856596.021260:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436219008 00000100:00100000:1.0:1787856596.021333:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856596.021341:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a85edf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+6:6473:x1874703436219008:12345-0@lo:101: 00010000:00010000:1.0:1787856596.021351:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856596.021362:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e504b7d8/0xc25410d92a3c3595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c358e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.021381:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e504b7d8/0xc25410d92a3c3595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c358e expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.021390:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e504b7d8/0xc25410d92a3c3595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c358e expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.021398:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e504b7d8, rc 0) 00000100:00100000:1.0:1787856596.021442:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a85edf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+7:6473:x1874703436219008:12345-0@lo:101: Request processed in 103us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856596.021448:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787856596.021518:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219008:0@lo:101: 00010000:00010000:3.0:1787856596.021531:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000c6e2ae77/0xc25410d92a3c358e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.021539:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000c6e2ae77/0xc25410d92a3c358e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856596.021551:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787856596.021566:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000c6e2ae77/0xc25410d92a3c358e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.021573:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000c6e2ae77/0xc25410d92a3c358e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856596.021580:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787856596.021584:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787856596.021590:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9065d3be8000 10000000:01000000:3.0:1787856596.021592:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787856596.021601:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787856596.021603:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787856596.021618:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.021624:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.021631:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856596.021644:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7cb8855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219136:0@lo:101: 00000100:00100000:3.0:1787856596.021683:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856596.021917:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030a315ac going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.022053:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436219136 00000100:00100000:2.0:1787856596.022057:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436219136 00000100:00100000:2.0:1787856596.022079:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856596.022085:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaecac2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+7:6473:x1874703436219136:12345-0@lo:101: 00010000:00010000:2.0:1787856596.022091:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856596.022099:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c359c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.022113:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c359c expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.022131:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c359c expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.022138:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000246d2fbd, rc 0) 00000100:00100000:2.0:1787856596.022183:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaecac2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+8:6473:x1874703436219136:12345-0@lo:101: Request processed in 98us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.022189:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856596.022312:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7cb8855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219136:0@lo:101: 00010000:00010000:3.0:1787856596.022322:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.022329:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856596.022378:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7cb8855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219264:0@lo:501: 00000100:00100000:3.0:1787856596.022400:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856596.022424:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030a315ac going to sleep for 11 seconds 00000100:00100000:1.0:1787856596.022479:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436219264 00000100:00100000:1.0:1787856596.022483:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436219264 00000100:00100000:1.0:1787856596.022501:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787856596.022506:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053347ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+8:6473:x1874703436219264:12345-0@lo:501: 00000100:00100000:1.0:1787856596.022604:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053347ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+9:6473:x1874703436219264:12345-0@lo:501: Request processed in 97us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856596.022610:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856596.022665:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7cb8855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219264:0@lo:501: 00000100:00100000:3.0:1787856596.022687:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7cb8855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219392:0@lo:503: 00000100:00100000:3.0:1787856596.022722:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856596.022748:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030a315ac going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.022905:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436219392 00000100:00100000:2.0:1787856596.022910:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436219392 00000100:00100000:2.0:1787856596.022938:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856596.022953:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000942953ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+9:6473:x1874703436219392:12345-0@lo:503: 00000100:00100000:2.0:1787856596.023043:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000942953ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+9:6473:x1874703436219392:12345-0@lo:503: Request processed in 91us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.023050:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856596.023442:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7cb8855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219392:0@lo:503: 00000100:00100000:2.0:1787856596.023916:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039efa417 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:6518:1874703436219520:0@lo:502: 00000100:00100000:2.0:1787856596.023977:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856596.024041:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f36f5ce8 going to sleep for 11 seconds 00000100:00100000:0.0:1787856596.024148:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436219520 00000100:00100000:0.0:1787856596.024153:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436219520 00000100:00100000:3.0:1787856596.027280:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856596.027306:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058b9c94d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+9:6518:x1874703436219520:12345-0@lo:502: 00000100:00100000:3.0:1787856596.027479:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058b9c94d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+9:6518:x1874703436219520:12345-0@lo:502: Request processed in 186us (3502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856596.027486:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787856596.027637:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039efa417 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:6518:1874703436219520:0@lo:502: 00000020:01000000:2.0:1787856596.027668:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856596.027679:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856596.027682:0:6518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787856596.027687:0:6518:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787856596.027690:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856596.027701:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000057bcd24) 00000020:00000080:2.0:1787856596.027716:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787856596.027720:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787856596.027917:0:6518:0:(osd_handler.c:8928:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787856596.028074:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c35b1 00000020:00000080:2.0:1787856596.028377:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787856596.028382:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856596.028385:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856596.028386:0:6518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787856596.028389:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856596.028392:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856596.028393:0:6518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787856596.028396:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856596.028403:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000000c4ebc6) 00000020:00000080:2.0:1787856596.028411:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787856596.028414:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787856596.028416:0:6518:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787856596.028419:0:6518:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787856596.028423:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787856596.028484:0:6518:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003dbd70aa from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787856596.028494:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000303e5c5) 00000020:00000080:2.0:1787856596.028501:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787856596.028556:0:6518:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787856596.028561:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c35c6 00000020:00000080:2.0:1787856596.028651:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787856596.028656:0:6518:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787856596.028659:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc25410d92a3c35cd 00080000:01000000:2.0:1787856596.028663:0:6518:0:(osd_handler.c:8928:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787856596.028666:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c35d4 00080000:10000000:2.0:1787856596.029652:0:6518:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787856596.029797:0:6518:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787856596.034462:0:6518:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787856596.117541:0:6518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787856596.117910:0:6518:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787856596.123898:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787856596.124352:0:6518:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787856596.128329:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a9f19792) 00000020:00000080:1.0:1787856596.128356:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787856596.128423:0:6518:0:(osd_handler.c:8928:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787856596.128429:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c35e2 00000020:00000080:1.0:1787856596.131640:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787856596.135914:0:6518:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1787856596.139353:0:6518:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787856596.146504:0:6518:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787856596.150664:0:6518:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787856596.152911:0:6518:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787856596.156537:0:6518:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1787856596.158449:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc25410d92a3c35e9 00000020:00000080:0.0:1787856596.159149:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787856596.159174:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856596.159180:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856596.159188:0:6518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787856596.159192:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856596.159196:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856596.159197:0:6518:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787856596.159200:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787856596.159202:0:6518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787856596.159205:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856596.159207:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856596.159208:0:6518:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787856596.159210:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856596.159236:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856596.159238:0:6518:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787856596.159243:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787856596.159297:0:6518:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787856596.159357:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:6518:1874703436219648:0@lo:502: 00000100:00100000:0.0:1787856596.159440:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.159496:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6a1092e going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.159631:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436219648 00000100:00100000:2.0:1787856596.159638:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436219648 00000100:00100000:2.0:1787856596.159672:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787856596.159679:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b634399a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+9:6518:x1874703436219648:12345-0@lo:502: 00000100:00100000:2.0:1787856596.160113:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b634399a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+9:6518:x1874703436219648:12345-0@lo:502: Request processed in 434us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.160122:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787856596.160450:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:6518:1874703436219648:0@lo:502: 00000020:01000000:0.0:1787856596.160479:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856596.160485:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856596.160487:0:6518:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787856596.160491:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787856596.160760:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787856596.160782:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787856596.160799:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.160817:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856596.160825:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065d3be8000 from 1 10000000:01000000:1.0:1787856596.160827:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787856596.160855:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.160862:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.160870:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856596.160886:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073a7cf5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219776:0@lo:101: 00000100:00100000:1.0:1787856596.160919:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856596.161166:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c58a378f going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.161410:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436219776 00000100:00100000:2.0:1787856596.161416:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436219776 00000100:00100000:2.0:1787856596.161490:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787856596.161498:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005362ea0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+9:6473:x1874703436219776:12345-0@lo:101: 00010000:00010000:2.0:1787856596.161509:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856596.161521:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c35f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.161542:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.161551:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.161558:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4e79d3f, rc 0) 00000100:00100000:2.0:1787856596.161598:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005362ea0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+10:6473:x1874703436219776:12345-0@lo:101: Request processed in 102us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.161605:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787856596.161661:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073a7cf5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219776:0@lo:101: 00010000:00010000:1.0:1787856596.161671:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.161688:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856596.162404:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073a7cf5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219904:0@lo:256: 00000100:00100000:1.0:1787856596.162448:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856596.163561:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436219904 00000100:00100000:3.0:1787856596.163571:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436219904 00000100:00100000:3.0:1787856596.163611:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787856596.163619:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fb25af6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+10:6473:x1874703436219904:12345-0@lo:256: 20000000:01000000:3.0:1787856596.163639:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787856596.163644:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787856596.163713:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fb25af6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+10:6473:x1874703436219904:12345-0@lo:256: Request processed in 95us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856596.163720:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787856596.163912:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c58a378f going to sleep for 11 seconds 00000100:00100000:0.0:1787856596.164015:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073a7cf5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436219904:0@lo:256: 10000000:01000000:0.0:1787856596.165043:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787856596.165109:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856596.165121:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856596.166115:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065d3be8000 from 1 10000000:01000000:0.0:1787856596.166118:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787856596.166286:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856596.166294:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856596.166303:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856596.166326:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220032:0@lo:101: 00000100:00100000:0.0:1787856596.166398:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.166501:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6a1092e going to sleep for 11 seconds 00000100:00100000:3.0:1787856596.166545:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436220032 00000100:00100000:3.0:1787856596.166552:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436220032 00000100:00100000:3.0:1787856596.166639:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787856596.166648:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a1ceb38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+10:6473:x1874703436220032:12345-0@lo:101: 00010000:00010000:3.0:1787856596.166660:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856596.166677:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c35fe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.166713:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.166723:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.166742:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5c753ea, rc 0) 00000100:00100000:3.0:1787856596.166785:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a1ceb38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+11:6473:x1874703436220032:12345-0@lo:101: Request processed in 138us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856596.166791:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856596.166856:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220032:0@lo:101: 00010000:00010000:0.0:1787856596.166869:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856596.166876:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856596.167060:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220160:0@lo:501: 00000100:00100000:0.0:1787856596.167085:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.167183:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6a1092e going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.167377:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436220160 00000100:00100000:2.0:1787856596.167383:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436220160 00000100:00100000:2.0:1787856596.167409:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787856596.167415:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a10479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+11:6473:x1874703436220160:12345-0@lo:501: 00000100:00100000:2.0:1787856596.167574:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a10479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+11:6473:x1874703436220160:12345-0@lo:501: Request processed in 159us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.167582:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787856596.167679:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220160:0@lo:501: 00000100:00100000:0.0:1787856596.167706:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220288:0@lo:503: 00000100:00100000:0.0:1787856596.167762:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.167788:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6a1092e going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.167875:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436220288 00000100:00100000:2.0:1787856596.167880:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436220288 00000100:00100000:2.0:1787856596.167896:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787856596.167902:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e74b366e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+11:6473:x1874703436220288:12345-0@lo:503: 00000040:00080000:2.0:1787856596.167949:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787856596.167991:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e74b366e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+11:6473:x1874703436220288:12345-0@lo:503: Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.167998:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787856596.168118:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220288:0@lo:503: 00000040:00080000:0.0:1787856596.170481:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787856596.170684:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787856596.170706:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787856596.170832:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.170845:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856596.170899:0:6473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787856596.170902:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9065d3be8000 10000000:01000000:3.0:1787856596.170905:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9065d3be8000 10000000:01000000:3.0:1787856596.170909:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787856596.170915:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065d3be8000 from 1 10000000:01000000:3.0:1787856596.170918:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787856596.171055:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.171063:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.171091:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856596.171113:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7cb8855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220416:0@lo:101: 00000100:00100000:3.0:1787856596.171662:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856596.171832:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c1e1a6d going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.171898:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436220416 00000100:00100000:2.0:1787856596.171905:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436220416 00000100:00100000:2.0:1787856596.172053:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856596.172062:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000111ee63e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+11:6473:x1874703436220416:12345-0@lo:101: 00010000:00010000:2.0:1787856596.172076:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856596.172088:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c360c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.172111:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c360c expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.172122:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c360c expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856596.172129:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ea85f8d, rc 0) 00000100:00100000:2.0:1787856596.172186:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000111ee63e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+12:6473:x1874703436220416:12345-0@lo:101: Request processed in 127us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.172193:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787856596.172289:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7cb8855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220416:0@lo:101: 00010000:00010000:0.0:1787856596.172303:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856596.172311:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856596.172370:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220544:0@lo:501: 00000100:00100000:0.0:1787856596.172410:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.172667:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4be021d going to sleep for 11 seconds 00000100:00100000:3.0:1787856596.172740:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436220544 00000100:00100000:3.0:1787856596.172745:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436220544 00000100:00100000:3.0:1787856596.172768:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787856596.172775:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085a96c5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6473:x1874703436220544:12345-0@lo:501: 00000100:00100000:3.0:1787856596.172892:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085a96c5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6473:x1874703436220544:12345-0@lo:501: Request processed in 118us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856596.172899:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787856596.173078:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220544:0@lo:501: 00000100:00100000:0.0:1787856596.173110:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220672:0@lo:503: 00000100:00100000:0.0:1787856596.173166:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.173182:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4be021d going to sleep for 11 seconds 00000100:00100000:3.0:1787856596.173312:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436220672 00000100:00100000:3.0:1787856596.173316:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436220672 00000100:00100000:3.0:1787856596.173335:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787856596.173340:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004062a806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6473:x1874703436220672:12345-0@lo:503: 00000100:00100000:3.0:1787856596.173461:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004062a806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6473:x1874703436220672:12345-0@lo:503: Request processed in 120us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856596.173468:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787856596.173628:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436220672:0@lo:503: 00000100:00100000:3.0:1787856596.174319:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a870969b pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:6523:1874703436220800:0@lo:502: 00000100:00100000:3.0:1787856596.174360:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856596.174482:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6b3ae36 going to sleep for 11 seconds 00000100:00100000:0.0:1787856596.174513:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436220800 00000100:00100000:0.0:1787856596.174517:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436220800 00000100:00100000:0.0:1787856596.174586:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787856596.174594:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de0b539a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6523:x1874703436220800:12345-0@lo:502: 00000100:00100000:0.0:1787856596.174682:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de0b539a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6523:x1874703436220800:12345-0@lo:502: Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856596.174689:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787856596.174763:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a870969b pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:6523:1874703436220800:0@lo:502: 00000020:01000004:3.0:1787856596.174821:0:6523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787856596.174840:0:6523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000250477fa) 00000020:00000080:3.0:1787856596.174857:0:6523:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787856596.174953:0:6523:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003dbd70aa from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787856596.174957:0:6523:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003dbd70aa from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787856596.174960:0:6523:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003dbd70aa 4 00010000:00080000:3.0:1787856596.174988:0:6523:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000c434cec@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1787856596.177522:0:6523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787856596.178025:0:6523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787856596.178067:0:6523:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787856596.178079:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc25410d92a3c3621 00000100:00080000:3.0:1787856596.178088:0:6523:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787856596.178093:0:6523:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000c434cec using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856596.178124:0:6523:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a870969b x1874703436220928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856596.178241:0:6523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787856596.178708:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a870969b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436220928:0@lo:38: 00000100:00100000:2.0:1787856596.178861:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856596.179078:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436220928 00000100:00100000:0.0:1787856596.179086:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436220928 00000100:00100000:0.0:1787856596.179126:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787856596.179133:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039efa417 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874703436220928:12345-0@lo:38: 00000100:00100000:0.0:1787856596.179281:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039efa417 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874703436220928:12345-0@lo:38: Request processed in 147us (421us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787856596.179289:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787856596.179379:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787856596.179463:0:3622:0:(import.c:65:import_set_state_nolock()) 000000000c434cec lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856596.179467:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787856596.179471:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a870969b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436220928:0@lo:38: 00000100:00100000:3.0:1787856596.179914:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:6523:1874703436221056:0@lo:502: 00000100:00100000:3.0:1787856596.180081:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856596.180117:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba69bbd5 going to sleep for 11 seconds 00000100:00100000:2.0:1787856596.180347:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436221056 00000100:00100000:2.0:1787856596.180353:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436221056 00000100:00100000:2.0:1787856596.180465:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787856596.180474:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0d2e0d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:6523:x1874703436221056:12345-0@lo:502: 00000100:00100000:2.0:1787856596.180636:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0d2e0d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:6523:x1874703436221056:12345-0@lo:502: Request processed in 164us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856596.180644:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787856596.187049:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:6523:1874703436221056:0@lo:502: 00000040:00080000:0.0:1787856596.188661:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787856596.189698:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787856596.189726:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787856596.189750:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.189762:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787856596.189873:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787856596.189876:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856596.189878:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856596.189879:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856596.189880:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856596.189881:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856596.189883:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856596.189884:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787856596.189885:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856596.189886:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856596.189888:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856596.189890:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787856596.189893:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787856596.189896:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787856596.189897:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856596.189899:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856596.189900:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856596.189901:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856596.189902:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856596.189903:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856596.189904:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787856596.189905:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856596.189906:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856596.189907:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856596.189907:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787856596.189950:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787856596.189969:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436221184:0@lo:253: 00000100:00100000:2.0:1787856596.190040:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856596.190091:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000856220a4 going to sleep for 11 seconds 00000100:00100000:0.0:1787856596.190267:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436221184 00000100:00100000:0.0:1787856596.190274:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436221184 00000100:00100000:0.0:1787856596.190320:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856596.190328:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b763cf90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6473:x1874703436221184:12345-0@lo:253: 20000000:01000000:0.0:1787856596.190354:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787856596.190368:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787856596.196099:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787856596.196163:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787856596.196472:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b763cf90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6473:x1874703436221184:12345-0@lo:253: Request processed in 6141us (6428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856596.196484:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787856596.196638:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:6473:1874703436221184:0@lo:253: 10000000:01000000:2.0:1787856596.196652:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787856596.196655:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787856596.196657:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856596.196658:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856596.196659:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856596.196661:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856596.196662:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856596.196663:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856596.196664:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787856596.196666:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856596.196667:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856596.196668:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856596.196670:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787856596.196683:0:6473:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787856596.200381:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787856596.200394:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787856596.200421:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.200439:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.200448:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.200491:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.200507:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 11 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856596.200521:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091693c6d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436221312:0@lo:104: 00000100:00100000:1.0:1787856596.200585:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856596.200633:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c58a378f going to sleep for 11 seconds 00000100:00100000:3.0:1787856596.200699:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436221312 00000100:00100000:3.0:1787856596.200706:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436221312 00000100:00100000:3.0:1787856596.200765:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856596.200791:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073a7cf5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6512:x1874703436221312:12345-0@lo:104: 00010000:00010000:3.0:1787856596.200802:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.200857:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787856596.200862:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073a7cf5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6512:x1874703436221312:12345-0@lo:104: Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856596.200868:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787856596.201070:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856596.201075:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.201094:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f54b6e6 already unused, calling callback (00000000f3ade360) 10000000:00010000:1.0:1787856596.201097:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.201104:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856596.201110:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856596.201115:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856596.201150:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.201166:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856596.201190:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.201196:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 000000009f54b6e6/0xc25410d92a3c35f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c35f7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.201237:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856596.201239:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856596.201241:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856596.201295:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856596.201303:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436221440:0@lo:103: 00000100:00100000:1.0:1787856596.201332:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856596.201374:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091693c6d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436221312:0@lo:104: 00010000:00010000:1.0:1787856596.201391:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856596.201585:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436221440 00000100:00100000:3.0:1787856596.201590:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436221440 00010000:00010000:3.0:1787856596.201606:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 12 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856596.201636:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856596.201642:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075336335 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+12:3623:x1874703436221440:12345-0@lo:103: 00010000:00010000:3.0:1787856596.201652:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856596.201655:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 12 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201664:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 12 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201675:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4e79d3f/0xc25410d92a3c35f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c35f0 expref: 12 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201686:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201692:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787856596.201712:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001319824s 00010000:00010000:3.0:1787856596.201715:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201721:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201726:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201741:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201745:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3b20cff already unused, calling callback (00000000c3795dd1) 00010000:00010000:3.0:1787856596.201748:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201753:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201770:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856596.201778:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856596.201808:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075336335 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+11:3623:x1874703436221440:12345-0@lo:103: Request processed in 167us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856596.201815:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856596.201838:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436221440:0@lo:103: 00010000:00010000:1.0:1787856596.202019:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.202026:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856596.202032:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b3b20cff/0xc25410d92a3c3628 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787856596.203319:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1787856596.203483:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787856596.203674:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787856596.204088:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787856596.204429:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1787856596.204595:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787856596.206098:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787856596.206506:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787856596.206679:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1787856596.207032:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787856596.207516:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1787856596.207683:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1787856596.211826:0:6473:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787856596.227820:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787856596.227839:0:6528:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787856596.227850:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787856596.228342:0:6529:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787856596.229759:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787856596.229909:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787856596.230383:0:6473:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787856596.230391:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787856596.230492:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856596.231559:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787856596.233011:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787856596.233085:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787856596.233621:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787856596.233954:0:6473:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1787856596.235036:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787856596.235395:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787856596.235562:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787856596.235689:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000040:00080000:0.0:1787856596.235896:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1787856596.236340:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787856596.236461:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787856596.236581:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787856596.236713:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787856596.237158:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787856596.238108:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787856596.238380:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787856596.238492:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787856596.238598:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787856596.238716:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787856596.240392:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787856596.246645:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787856596.247320:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787856596.247541:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787856596.247650:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787856596.247909:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787856596.248106:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787856596.248339:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787856596.248527:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787856596.248635:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000040:00080000:2.0:1787856596.248757:0:6529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787856596.248839:0:6529:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787856596.248844:0:6529:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1787856596.248910:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787856596.249144:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787856596.249372:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787856596.249586:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787856596.249753:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787856596.250389:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787856596.250534:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787856596.250666:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787856596.252509:0:6473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787856596.255649:0:6473:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787856596.255698:0:6473:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae99c1c67988 00100000:10000000:3.0:1787856596.255707:0:6473:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787856596.258644:0:6473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787856596.258664:0:6473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787856596.258686:0:6473:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1787856596.258707:0:6473:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787856596.259534:0:6473:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787856596.259698:0:6473:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787856596.817340:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856597.841528:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856598.866560:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856599.894440:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856600.914497:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787856601.204449:0:6774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787856601.425404:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787856601.425417:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787856601.425419:0:38:0:(import.c:65:import_set_state_nolock()) 000000000c434cec lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787856601.425432:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000c434cec using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856601.425455:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a4fddfa x1874703436221696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787856601.425545:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022a29e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436221568:0@lo:400: 00000100:00100000:2.0:1787856601.425621:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856601.425740:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436221696:0@lo:38: 00000100:00100000:2.0:1787856601.425769:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856601.425804:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436221568 00000100:00100000:2.0:1787856601.425811:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436221568 00000100:00100000:2.0:1787856601.425853:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787856601.425861:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006204a6ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+11:3625:x1874703436221568:12345-0@lo:400: 00000100:00100000:0.0:1787856601.427489:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436221696 00000100:00100000:0.0:1787856601.427499:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436221696 00000100:00100000:0.0:1787856601.427539:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856601.427545:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad2724e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874703436221696:12345-0@lo:38: 00010000:00080000:0.0:1787856601.427571:0:6498:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:0.0:1787856601.427614:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc25410d92a3c362f 00000004:00100000:0.0:1787856601.427682:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787856601.427807:0:6498:0:(import.c:65:import_set_state_nolock()) 0000000080c7e10d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856601.428431:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad2724e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874703436221696:12345-0@lo:38: Request processed in 883us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856601.428440:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787856601.428505:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008a4fddfa x1874703436221696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787856601.428524:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787856601.428533:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787856601.428537:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787856601.428539:0:3622:0:(import.c:65:import_set_state_nolock()) 000000000c434cec lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787856601.428545:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436221696:0@lo:38: 00000100:00100000:2.0:1787856601.428682:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006204a6ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+11:3625:x1874703436221568:12345-0@lo:400: Request processed in 2822us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856601.428692:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787856601.430483:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022a29e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436221568:0@lo:400: 00010000:00010000:2.0:1787856601.937516:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787856602.176451:0:6826:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856602.176640:0:6826:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787856602.961304:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787856603.473360:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787856603.473369:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065d3be8000 from 3 10000000:01000000:0.0:1787856603.473374:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787856603.473427:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856603.473440:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856603.473451:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856603.473475:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436221824:0@lo:101: 00000100:00100000:0.0:1787856603.473551:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856603.473645:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000000efcffda going to sleep for 11 seconds 00000100:00100000:3.0:1787856603.473860:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436221824 00000100:00100000:3.0:1787856603.473868:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436221824 00000100:00100000:3.0:1787856603.473929:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787856603.473937:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f2f806a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+11:6493:x1874703436221824:12345-0@lo:101: 00010000:00010000:3.0:1787856603.473950:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856603.473962:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3636 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856603.473983:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856603.473993:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856603.474002:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c352ba06, rc 0) 00000100:00100000:3.0:1787856603.474629:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f2f806a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:6493:x1874703436221824:12345-0@lo:101: Request processed in 692us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856603.474638:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787856603.474998:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436221824:0@lo:101: 00010000:00010000:0.0:1787856603.475016:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856603.475100:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856603.475163:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436221952:0@lo:256: 00000100:00100000:0.0:1787856603.475198:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856603.475288:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000000efcffda going to sleep for 11 seconds 00000100:00100000:2.0:1787856603.479203:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436221952 00000100:00100000:2.0:1787856603.479615:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436221952 00000100:00100000:2.0:1787856603.479748:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787856603.479759:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a201a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:6493:x1874703436221952:12345-0@lo:256: 20000000:01000000:2.0:1787856603.479796:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787856603.479814:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787856603.479818:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787856603.479991:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a201a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:6493:x1874703436221952:12345-0@lo:256: Request processed in 234us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856603.479999:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787856603.480991:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436221952:0@lo:256: 10000000:01000000:0.0:1787856603.481123:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787856603.481131:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856603.481141:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856603.985477:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856605.011883:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787856605.164330:0:6927:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787856605.164611:0:6927:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787856606.033604:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856606.547074:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a8f7cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436222080:0@lo:400: 00000100:00100000:2.0:1787856606.547155:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856606.547243:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d59811ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436222208:0@lo:400: 00000100:00100000:2.0:1787856606.547272:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856606.547312:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436222080 00000100:00100000:2.0:1787856606.547319:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436222080 00000100:00100000:2.0:1787856606.547363:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787856606.547369:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e474b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:3626:x1874703436222080:12345-0@lo:400: 00000100:00100000:2.0:1787856606.547417:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e474b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:3626:x1874703436222080:12345-0@lo:400: Request processed in 48us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856606.547424:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787856606.547460:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436222208 00000100:00100000:2.0:1787856606.547464:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436222208 00000100:00100000:2.0:1787856606.547490:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787856606.547496:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007c35e1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436222208:12345-0@lo:400: 00000100:00100000:2.0:1787856606.547532:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007c35e1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436222208:12345-0@lo:400: Request processed in 36us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856606.547552:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787856606.547592:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d59811ae x1874703436222208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856606.547605:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d59811ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436222208:0@lo:400: 00000100:00100000:2.0:1787856606.547632:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a8f7cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436222080:0@lo:400: 00010000:00010000:0.0:1787856607.058421:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856608.086075:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856609.105469:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856610.133131:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856611.153449:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856611.667330:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000119f59cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436222336:0@lo:400: 00000100:00100000:2.0:1787856611.667430:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856611.667505:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065e06cd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436222464:0@lo:400: 00000100:00100000:2.0:1787856611.667537:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856611.667578:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436222336 00000100:00100000:2.0:1787856611.667587:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436222336 00000100:00100000:2.0:1787856611.667641:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787856611.667651:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000393bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:3624:x1874703436222336:12345-0@lo:400: 00000100:00100000:2.0:1787856611.667708:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000393bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:3624:x1874703436222336:12345-0@lo:400: Request processed in 58us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856611.667715:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787856611.667769:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000119f59cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436222336:0@lo:400: 00000100:00100000:0.0:1787856611.668912:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436222464 00000100:00100000:0.0:1787856611.668921:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436222464 00000100:00100000:0.0:1787856611.668992:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856611.669001:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e388a729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436222464:12345-0@lo:400: 00000100:00100000:0.0:1787856611.669075:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e388a729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436222464:12345-0@lo:400: Request processed in 76us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856611.669093:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787856611.669147:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000065e06cd3 x1874703436222464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856611.669162:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065e06cd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436222464:0@lo:400: 00010000:00010000:3.0:1787856612.184096:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856613.208100:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856614.228060:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856615.253287:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787856615.924733:0:7426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787856615.924750:0:7426:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787856615.924752:0:7426:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787856615.924917:0:7426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008065a073 00000020:01000004:1.0:1787856615.924934:0:7426:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1787856615.924944:0:7426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787856615.924966:0:7426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000006ec022ff) 00000020:00000080:1.0:1787856615.924980:0:7426:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787856616.014581:0:7426:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1787856616.014667:0:7426:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1787856616.033485:0:7426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787856616.033696:0:7426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787856616.033708:0:7426:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787856616.033719:0:7426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c364b 00000020:01000004:2.0:1787856616.033726:0:7426:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787856616.033820:0:7426:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787856616.033830:0:7426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787856616.033837:0:7426:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787856616.033864:0:7426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787856616.033868:0:7426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787856616.060017:0:7426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787856616.060066:0:7426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.106@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1787856616.060072:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787856616.060073:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787856616.060074:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856616.060076:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856616.060076:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856616.060078:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856616.060079:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856616.060081:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856616.060083:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856616.060085:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856616.060086:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787856616.060090:0:7426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1787856616.060093:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787856616.060094:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787856616.060095:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856616.060097:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856616.060097:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856616.060098:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856616.060099:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856616.060100:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856616.060102:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856616.060103:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856616.060104:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787856616.060131:0:7426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787856616.060149:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000119f59cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436222592:0@lo:253: 00000100:00100000:2.0:1787856616.060311:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.060366:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f441b83 going to sleep for 11 seconds 00000100:00100000:3.0:1787856616.060471:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436222592 00000100:00100000:3.0:1787856616.060479:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436222592 00000100:00100000:3.0:1787856616.060530:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787856616.060537:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a49c979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436222592:12345-0@lo:253: 20000000:01000000:3.0:1787856616.060565:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787856616.060569:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1787856616.060573:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1787856616.060582:0:6488:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1787856616.060613:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1787856616.060920:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856616.061041:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787856616.061054:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787856616.061070:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787856616.061084:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787856616.061097:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787856616.061147:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1787856616.061155:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1787856616.061167:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1787856616.061173:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1787856616.061184:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1787856616.061189:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1787856616.061199:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787856616.061407:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787856616.061515:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1787856616.061525:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:3.0:1787856616.061537:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1787856616.061543:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787856616.061555:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1787856616.061560:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:3.0:1787856616.061571:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1787856616.061576:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787856616.061586:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787856616.061600:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787856616.061609:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787856616.061684:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1787856616.061694:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1787856616.061705:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787856616.061720:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787856616.061840:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1787856616.061849:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1787856616.061861:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787856616.061880:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787856616.061885:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1787856616.061905:0:6488:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787856616.061913:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1787856616.062719:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787856616.063073:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787856616.063093:0:6488:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.106@tcp for mdt 20000000:01000000:3.0:1787856616.063095:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:3.0:1787856616.063107:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787856616.063111:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787856616.063123:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787856616.063127:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:3.0:1787856616.063141:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787856616.063148:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1787856616.063159:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1787856616.063171:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1787856616.063212:0:6488:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1787856616.063452:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1787856616.063851:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787856616.064008:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787856616.064023:0:6488:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.106@tcp for mdt 20000000:01000000:3.0:1787856616.064025:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:3.0:1787856616.064040:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787856616.064046:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787856616.064058:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787856616.064062:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:3.0:1787856616.064073:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787856616.064079:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1787856616.064089:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787856616.064115:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1787856616.064132:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787856616.064135:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787856616.064138:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787856616.064183:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787856616.064185:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787856616.065063:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787856616.065088:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787856616.065102:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787856616.065409:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1787856616.065429:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1787856616.065442:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1787856616.065449:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787856616.065451:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787856616.065725:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787856616.065823:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787856616.065839:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787856616.065967:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787856616.065983:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787856616.065996:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787856616.066006:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787856616.066007:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787856616.066528:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787856616.066547:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787856616.066560:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787856616.066687:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787856616.066706:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787856616.066729:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787856616.066820:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787856616.066824:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787856616.066829:0:6488:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787856616.066837:0:6488:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787856616.067128:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1787856616.067337:0:6488:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787856616.083883:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787856616.084576:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.084598:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.084604:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c359c expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.084611:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c360c expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.084616:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.084661:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c360c expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.084676:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c360c expref: 12 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.084690:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2fa99be pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436222720:0@lo:104: 00000100:00100000:0.0:1787856616.086301:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856616.086436:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c359c expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.086465:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c359c expref: 12 pid: 6490 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.086477:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bad9ddb7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436222848:0@lo:104: 00000100:00100000:0.0:1787856616.086516:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856616.090687:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.090707:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 12 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.090721:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436222976:0@lo:104: 00000100:00100000:0.0:1787856616.090797:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.091072:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436222720 00000100:00100000:2.0:1787856616.091080:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436222720 00000100:00100000:2.0:1787856616.091123:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436222848 00000100:00100000:2.0:1787856616.091126:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436222848 00000100:00100000:2.0:1787856616.091158:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787856616.091164:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064a15ec5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:6488:x1874703436222720:12345-0@lo:104: 00010000:00010000:2.0:1787856616.091176:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.091254:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787856616.091258:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064a15ec5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:6488:x1874703436222720:12345-0@lo:104: Request processed in 95us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.091265:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787856616.091282:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787856616.091288:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff7c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:6488:x1874703436222848:12345-0@lo:104: 00010000:00010000:2.0:1787856616.091295:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.091326:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787856616.091330:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff7c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:6488:x1874703436222848:12345-0@lo:104: Request processed in 43us (4815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.091335:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787856616.094699:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856616.094713:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.094726:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068d7498c already unused, calling callback (00000000f3ade360) 10000000:00010000:0.0:1787856616.094730:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.094832:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436222976 00000100:00100000:2.0:1787856616.094841:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436222976 00000100:00100000:2.0:1787856616.094891:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856616.094899:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6cf2422 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:6488:x1874703436222976:12345-0@lo:104: 00010000:00010000:2.0:1787856616.094913:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.094995:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787856616.095000:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6cf2422 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:6488:x1874703436222976:12345-0@lo:104: Request processed in 103us (4205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.095027:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787856616.095130:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856616.095137:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856616.095142:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787856616.095201:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095208:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856616.095244:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095251:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c360c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3613 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095265:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856616.095268:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095273:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000589e42ad already unused, calling callback (00000000f3ade360) 10000000:00010000:0.0:1787856616.095275:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095281:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856616.095286:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856616.095290:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787856616.095303:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095310:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856616.095325:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095345:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 00000000589e42ad/0xc25410d92a3c359c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c35a3 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095356:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856616.095358:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095363:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000219a3342 already unused, calling callback (00000000f3ade360) 10000000:00010000:0.0:1787856616.095365:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095370:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856616.095377:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856616.095381:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787856616.095394:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095400:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856616.095404:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095409:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 00000000219a3342/0xc25410d92a3c3580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3587 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.095422:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856616.095429:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856616.095431:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856616.095447:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d9c24c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436223104:0@lo:103: 00000100:00100000:0.0:1787856616.095486:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.095546:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436223232:0@lo:103: 00000100:00100000:0.0:1787856616.095570:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.095588:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856616.095593:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002b902e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436223360:0@lo:103: 00000100:00100000:0.0:1787856616.095611:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.095646:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436223104 00000100:00100000:0.0:1787856616.095650:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436223104 00010000:00010000:0.0:1787856616.095672:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c360c expref: 13 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.095687:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436223232 00000100:00100000:0.0:1787856616.095690:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436223232 00010000:00010000:0.0:1787856616.095699:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c359c expref: 14 pid: 6490 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.095707:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436223360 00000100:00100000:0.0:1787856616.095710:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436223360 00010000:00010000:0.0:1787856616.095721:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 15 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.095732:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856616.096649:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011bc5800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+15:3626:x1874703436223104:12345-0@lo:103: 00010000:00010000:0.0:1787856616.096667:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856616.096674:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c360c expref: 15 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.096703:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c360c expref: 15 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.096724:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856616.097072:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011bc5800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+15:3626:x1874703436223104:12345-0@lo:103: Request processed in 432us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.097081:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856616.097109:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787856616.097116:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b2b76cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+14:3623:x1874703436223232:12345-0@lo:103: 00010000:00010000:0.0:1787856616.097124:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856616.097127:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c359c expref: 14 pid: 6490 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097136:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c359c expref: 14 pid: 6490 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097146:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856616.097173:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b2b76cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+14:3623:x1874703436223232:12345-0@lo:103: Request processed in 58us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.097179:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787856616.097191:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856616.097197:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0184ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+13:3623:x1874703436223360:12345-0@lo:103: 00010000:00010000:0.0:1787856616.097204:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856616.097207:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 13 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097843:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 13 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097869:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097877:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097892:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097899:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097905:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097912:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097917:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005aa841b already unused, calling callback (00000000c3795dd1) 00010000:00010000:0.0:1787856616.097921:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097928:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097935:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.097944:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856616.098117:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0184ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+13:3623:x1874703436223360:12345-0@lo:103: Request processed in 920us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.098135:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856616.098195:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f440d63a going to sleep for 11 seconds 00010000:00010000:0.0:1787856616.098242:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ea85f8d/0xc25410d92a3c3613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c360c expref: 12 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.098256:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2fa99be pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436222720:0@lo:104: 00010000:00010000:0.0:1787856616.098269:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c35a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c359c expref: 11 pid: 6490 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.098277:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bad9ddb7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436222848:0@lo:104: 00010000:00010000:0.0:1787856616.098285:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005218be24/0xc25410d92a3c3587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3580 expref: 10 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.098292:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436222976:0@lo:104: 00010000:00010000:0.0:1787856616.098314:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.098323:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.098328:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.098334:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005aa841b/0xc25410d92a3c3652 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787856616.098351:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787856616.099841:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002b902e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436223360:0@lo:103: 00000100:00100000:3.0:1787856616.099857:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecbb0500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436223232:0@lo:103: 00000100:00100000:2.0:1787856616.100134:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d9c24c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436223104:0@lo:103: 00010000:00010000:0.0:1787856616.100331:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856616.100721:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a49c979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+9:7426:x1874703436222592:12345-0@lo:253: Request processed in 40182us (40409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.100745:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787856616.100904:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000119f59cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436222592:0@lo:253: 10000000:01000000:0.0:1787856616.100928:0:7426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787856616.100931:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787856616.100933:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787856616.100934:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856616.100935:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787856616.100936:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856616.100937:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856616.100938:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787856616.100940:0:7426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787856616.100942:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856616.100943:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787856616.101042:0:7426:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008065a073 from lustre-MDT0001 10000000:01000000:0.0:1787856616.101079:0:7426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787856616.101082:0:7426:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787856616.101090:0:7426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9065e9fd0000 local copy 10000000:01000000:0.0:1787856616.101094:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787856616.101130:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.101140:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.101148:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.101167:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436223488:0@lo:101: 00000100:00100000:0.0:1787856616.101205:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.101278:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d83d4aa going to sleep for 11 seconds 00000100:00100000:2.0:1787856616.101397:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436223488 00000100:00100000:2.0:1787856616.101404:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436223488 00000100:00100000:2.0:1787856616.101444:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787856616.101451:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063f9084d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+9:7426:x1874703436223488:12345-0@lo:101: 00010000:00010000:2.0:1787856616.101465:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856616.101477:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3659 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.101497:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3659 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.101506:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3659 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.101515:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f320ba2, rc 0) 00000100:00100000:2.0:1787856616.101553:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063f9084d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+10:7426:x1874703436223488:12345-0@lo:101: Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.101559:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787856616.101665:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436223488:0@lo:101: 00010000:00010000:0.0:1787856616.101677:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.101696:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.101862:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436223616:0@lo:501: 00000100:00100000:0.0:1787856616.101887:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.101913:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d83d4aa going to sleep for 11 seconds 00000100:00100000:2.0:1787856616.102036:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436223616 00000100:00100000:2.0:1787856616.102042:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436223616 00000100:00100000:2.0:1787856616.102072:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787856616.102079:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035700159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+10:7426:x1874703436223616:12345-0@lo:501: 00000100:00100000:2.0:1787856616.102154:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035700159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+10:7426:x1874703436223616:12345-0@lo:501: Request processed in 75us (266us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787856616.102162:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787856616.102286:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436223616:0@lo:501: 10000000:01000000:0.0:1787856616.102299:0:7426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787856616.102315:0:7426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787856616.102319:0:7426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.102327:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.102334:0:7426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.102358:0:7426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787856616.102384:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9065f7199800 10000000:01000000:0.0:1787856616.102390:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787856616.102394:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9065e9fd0000 10000000:01000000:0.0:1787856616.102397:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787856616.102400:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9065e9fd0000 from 1 10000000:01000000:0.0:1787856616.102402:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787856616.102416:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000f138d27d/0xc25410d92a3c3667 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.102433:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000f138d27d/0xc25410d92a3c3667 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.102442:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000f138d27d/0xc25410d92a3c3667 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.102453:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436223744:0@lo:101: 00000100:00100000:0.0:1787856616.102477:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.102499:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096c0b6e2 going to sleep for 11 seconds 00000100:00100000:3.0:1787856616.102552:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436223744 00000100:00100000:3.0:1787856616.102562:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436223744 00000100:00100000:3.0:1787856616.102596:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787856616.102602:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011ecacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+10:7426:x1874703436223744:12345-0@lo:101: 00010000:00010000:3.0:1787856616.102610:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856616.102619:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000131b5435/0xc25410d92a3c366e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3667 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856616.102633:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000131b5435/0xc25410d92a3c366e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3667 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856616.102640:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000131b5435/0xc25410d92a3c366e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3667 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856616.102647:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000131b5435, rc 0) 00000100:00100000:3.0:1787856616.102673:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011ecacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+11:7426:x1874703436223744:12345-0@lo:101: Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856616.102678:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787856616.102821:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436223744:0@lo:101: 00010000:00010000:0.0:1787856616.102831:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000f138d27d/0xc25410d92a3c3667 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c366e expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.102837:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000f138d27d/0xc25410d92a3c3667 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c366e expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856616.102850:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787856616.102915:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856616.102921:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.102927:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000018dae708 already unused, calling callback (00000000f3ade360) 10000000:00010000:2.0:1787856616.102930:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.102936:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856616.102942:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856616.102947:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787856616.103023:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000f138d27d/0xc25410d92a3c3667 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c366e expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.103030:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000f138d27d/0xc25410d92a3c3667 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c366e expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856616.103038:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9065f7199800 10000000:01000000:0.0:1787856616.103042:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787856616.103045:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9065f7199800 from 1 10000000:01000000:0.0:1787856616.103046:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787856616.103077:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000dc2ef490/0xc25410d92a3c3675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.103087:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000dc2ef490/0xc25410d92a3c3675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.103093:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000dc2ef490/0xc25410d92a3c3675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.103103:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436223872:0@lo:101: 00000100:00100000:0.0:1787856616.103127:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.103149:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096c0b6e2 going to sleep for 11 seconds 00010000:00010000:2.0:1787856616.103195:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.103202:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856616.103248:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.103255:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 0000000018dae708/0xc25410d92a3c3659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c3660 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.103270:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856616.103271:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856616.103278:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856616.103287:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856616.103298:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065e06cd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436224000:0@lo:103: 00000100:00100000:2.0:1787856616.103327:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.103360:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436224000 00000100:00100000:2.0:1787856616.103364:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436224000 00000100:00100000:2.0:1787856616.103396:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787856616.103402:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d59811ae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+11:3626:x1874703436224000:12345-0@lo:103: 00010000:00010000:2.0:1787856616.103410:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856616.103421:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3659 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.103433:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856616.103457:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d59811ae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+10:3626:x1874703436224000:12345-0@lo:103: Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.103463:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787856616.103490:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065e06cd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436224000:0@lo:103: 00000100:00100000:0.0:1787856616.105305:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436223872 00000100:00100000:0.0:1787856616.105316:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436223872 00000100:00100000:0.0:1787856616.105369:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787856616.105377:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ca5f785 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+10:7426:x1874703436223872:12345-0@lo:101: 00010000:00010000:0.0:1787856616.105391:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856616.105404:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003a3142f/0xc25410d92a3c367c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3675 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.105428:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003a3142f/0xc25410d92a3c367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3675 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.105437:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003a3142f/0xc25410d92a3c367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3675 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.105445:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003a3142f, rc 0) 00000100:00100000:0.0:1787856616.105511:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ca5f785 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+11:7426:x1874703436223872:12345-0@lo:101: Request processed in 134us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.105517:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787856616.105731:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436223872:0@lo:101: 00010000:00010000:1.0:1787856616.105876:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000dc2ef490/0xc25410d92a3c3675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856616.105885:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000dc2ef490/0xc25410d92a3c3675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856616.105903:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787856616.106930:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000dc2ef490/0xc25410d92a3c3675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856616.106942:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000dc2ef490/0xc25410d92a3c3675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856616.108859:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787856616.108902:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787856616.108911:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9065f7199800 10000000:01000000:1.0:1787856616.108914:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787856616.108917:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787856616.108920:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787856616.108971:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856616.108983:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856616.109015:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856616.109038:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ae37dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224128:0@lo:101: 00000100:00100000:1.0:1787856616.109114:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856616.109166:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d75c9cd going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.109326:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436224128 00000100:00100000:0.0:1787856616.109342:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436224128 00000100:00100000:0.0:1787856616.109392:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856616.109400:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c76a6bd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+11:7426:x1874703436224128:12345-0@lo:101: 00010000:00010000:0.0:1787856616.109414:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856616.109426:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3683 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.109448:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.109458:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.109466:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ee9b244, rc 0) 00000100:00100000:0.0:1787856616.109513:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c76a6bd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224128:12345-0@lo:101: Request processed in 113us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.109520:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787856616.109720:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ae37dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224128:0@lo:101: 00010000:00010000:2.0:1787856616.109747:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.109763:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.109870:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065e06cd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224256:0@lo:501: 00000100:00100000:2.0:1787856616.109902:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.109939:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f441b83 going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.110101:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436224256 00000100:00100000:0.0:1787856616.110106:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436224256 00000100:00100000:0.0:1787856616.110142:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856616.110148:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000442d61ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224256:12345-0@lo:501: 00000100:00100000:0.0:1787856616.110302:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000442d61ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224256:12345-0@lo:501: Request processed in 154us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.110310:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787856616.110542:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065e06cd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224256:0@lo:501: 00000100:00100000:2.0:1787856616.110585:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065e06cd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224384:0@lo:503: 00000100:00100000:2.0:1787856616.110628:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.111874:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f441b83 going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.115425:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436224384 00000100:00100000:0.0:1787856616.115441:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436224384 00000100:00100000:0.0:1787856616.116881:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787856616.116899:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e77e6bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224384:12345-0@lo:503: 00000100:00100000:0.0:1787856616.117119:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e77e6bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224384:12345-0@lo:503: Request processed in 226us (6490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.117135:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787856616.117271:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065e06cd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224384:0@lo:503: 00000040:00080000:1.0:1787856616.117566:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856616.117655:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d84fa968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224512:0@lo:502: 00000100:00100000:1.0:1787856616.117706:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856616.123365:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a36e8dfb going to sleep for 11 seconds 00000100:00100000:2.0:1787856616.127094:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436224512 00000100:00100000:2.0:1787856616.127110:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436224512 00000100:00100000:2.0:1787856616.127182:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787856616.127192:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006891108e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224512:12345-0@lo:502: 00000100:00100000:2.0:1787856616.127400:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006891108e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224512:12345-0@lo:502: Request processed in 210us (9695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.127408:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787856616.127623:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d84fa968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224512:0@lo:502: 00000040:00080000:1.0:1787856616.127941:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787856616.127987:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1787856616.128002:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1787856616.128016:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1787856616.128029:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1787856616.128042:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1787856616.128054:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1787856616.128065:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1787856616.128085:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1787856616.128101:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1787856616.128114:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1787856616.128128:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1787856616.128141:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1787856616.128155:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1787856616.128167:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1787856616.128181:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1787856616.128209:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1787856616.128259:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1787856616.128275:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1787856616.128289:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1787856616.128303:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1787856616.128317:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1787856616.128330:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1787856616.128367:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d84fa968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224640:0@lo:502: 00000100:00100000:1.0:1787856616.128422:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856616.128459:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a36e8dfb going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.128666:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436224640 00000100:00100000:0.0:1787856616.128673:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436224640 00000100:00100000:0.0:1787856616.128709:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787856616.128715:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003be701b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224640:12345-0@lo:502: 00000100:00100000:0.0:1787856616.128940:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003be701b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436224640:12345-0@lo:502: Request processed in 224us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.129007:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787856616.129119:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d84fa968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436224640:0@lo:502: 00000040:00080000:1.0:1787856616.129172:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1787856616.129182:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1787856616.139182:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856616.139203:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.139206:0:7438:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787856616.139213:0:7438:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787856616.139234:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787856616.139251:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000092f5af46) 00000020:00000080:0.0:1787856616.139275:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1787856616.139283:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787856616.139408:0:7438:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787856616.139416:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c3698 00000020:00000080:0.0:1787856616.139654:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787856616.139659:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856616.139663:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.139665:0:7438:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787856616.139668:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856616.139671:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.139672:0:7438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787856616.139675:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787856616.139683:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000957fed55) 00000020:00000080:0.0:1787856616.139693:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1787856616.139697:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787856616.139698:0:7438:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787856616.139707:0:7438:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787856616.139714:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787856616.139867:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008065a073 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787856616.139882:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000f1927747) 00000020:00000080:0.0:1787856616.139890:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1787856616.139948:0:7438:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787856616.140039:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c36ad 00000020:00000080:0.0:1787856616.140134:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787856616.140140:0:7438:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787856616.140146:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc25410d92a3c36b4 00080000:01000000:0.0:1787856616.140151:0:7438:0:(osd_handler.c:8928:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787856616.140155:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c36bb 00080000:10000000:0.0:1787856616.140719:0:7438:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787856616.144663:0:7438:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1787856616.249926:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1787856616.250195:0:7438:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1787856616.255761:0:7438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787856616.256162:0:7438:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1787856616.275350:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787856616.276274:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787856616.276288:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856616.276295:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856616.276298:0:7438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787856616.276302:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856616.276310:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856616.276311:0:7438:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787856616.276314:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787856616.276319:0:7438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:2.0:1787856616.276350:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856616.276382:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000009ca4bbe2) 00000020:00000080:2.0:1787856616.276409:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787856616.276416:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787856616.276493:0:7438:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787856616.276499:0:7438:0:(osd_handler.c:8928:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787856616.276505:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c36c9 00010000:00080000:2.0:1787856616.276536:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a7cedd31@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1787856616.284474:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1787856616.285523:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787856616.285537:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787856616.285571:0:7438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787856616.285594:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c36d0 00000100:00080000:0.0:1787856616.285606:0:7438:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787856616.285611:0:7438:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000a7cedd31 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856616.285660:0:7438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bad9ddb7 x1874703436224768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787856616.285717:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bad9ddb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436224768:0@lo:38: 00000100:00080000:0.0:1787856616.285813:0:7438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787856616.285923:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856616.285928:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.285930:0:7438:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787856616.285932:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787856616.285936:0:7438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787856616.285937:0:7438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787856616.285939:0:7438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787856616.285947:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787856616.285950:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.285951:0:7438:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787856616.285954:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856616.285959:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.285960:0:7438:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787856616.285963:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787856616.286134:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856616.286331:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436224768 00000100:00100000:1.0:1787856616.286339:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436224768 00000004:01000000:0.0:1787856616.286360:0:7438:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787856616.286388:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856616.286392:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.286394:0:7438:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787856616.286397:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856616.286399:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.286401:0:7438:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787856616.286404:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787856616.286405:0:7438:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787856616.286425:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787856616.286432:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a8f7cde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436224768:12345-0@lo:38: 00000020:01000000:0.0:1787856616.286433:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856616.286435:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856616.286437:0:7438:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787856616.286439:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00010000:00080000:1.0:1787856616.286455:0:6501:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:1.0:1787856616.286485:0:6501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c36d7 00000004:00100000:1.0:1787856616.286500:0:6501:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787856616.286505:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787856616.287527:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2fa99be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436224896:0@lo:400: 00000100:00100000:3.0:1787856616.287585:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856616.287750:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436224896 00000100:00100000:1.0:1787856616.287765:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436224896 00000100:00100000:1.0:1787856616.287817:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856616.287825:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc8b0f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436224896:12345-0@lo:400: 00000020:01000000:2.0:1787856616.287847:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:1.0:1787856616.287883:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc8b0f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436224896:12345-0@lo:400: Request processed in 59us (298us total) trans 0 rc 0/0 10000000:01000000:2.0:1787856616.287885:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787856616.287899:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856616.287902:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787856616.287908:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856616.287915:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065f7199800 from 1 10000000:01000000:2.0:1787856616.287918:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787856616.287941:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.287953:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.287962:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787856616.288013:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e2fa99be x1874703436224896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856616.288027:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2fa99be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436224896:0@lo:400: 00000100:00100000:2.0:1787856616.288131:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6dfa6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225024:0@lo:101: 00000100:00100000:2.0:1787856616.288165:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.288273:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c90416a3 going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.288388:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436225024 00000100:00100000:0.0:1787856616.288393:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436225024 00000100:00100000:0.0:1787856616.288676:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787856616.288686:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbcd38bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+12:7426:x1874703436225024:12345-0@lo:101: 00010000:00010000:0.0:1787856616.288696:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856616.288709:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c36de expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.288730:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c36de expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.288740:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c36de expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.288767:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f11bd0be, rc 0) 00000100:00100000:0.0:1787856616.288815:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbcd38bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+13:7426:x1874703436225024:12345-0@lo:101: Request processed in 131us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.288820:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787856616.288896:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6dfa6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225024:0@lo:101: 00010000:00010000:2.0:1787856616.288911:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.288919:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.289495:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6dfa6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225152:0@lo:256: 00000100:00100000:2.0:1787856616.289545:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.290273:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c90416a3 going to sleep for 11 seconds 00000100:00100000:1.0:1787856616.290450:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436225152 00000100:00100000:1.0:1787856616.290457:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436225152 00000100:00100000:2.0:1787856616.290614:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787856616.290626:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1a6902a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+13:7426:x1874703436225152:12345-0@lo:256: 20000000:01000000:2.0:1787856616.290646:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787856616.290665:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787856616.290668:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787856616.290773:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1a6902a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+13:7426:x1874703436225152:12345-0@lo:256: Request processed in 151us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.290781:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787856616.290965:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6dfa6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225152:0@lo:256: 10000000:01000000:3.0:1787856616.291668:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787856616.291689:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856616.291701:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856616.291709:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065f7199800 from 1 10000000:01000000:3.0:1787856616.291712:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787856616.291744:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856616.291760:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856616.291768:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856616.291786:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6cf4e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225280:0@lo:101: 00000100:00100000:3.0:1787856616.291828:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856616.291858:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cce33848 going to sleep for 11 seconds 00000100:00100000:2.0:1787856616.291999:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436225280 00000100:00100000:2.0:1787856616.292007:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436225280 00000100:00100000:2.0:1787856616.292038:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787856616.292044:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000254e47b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+13:7426:x1874703436225280:12345-0@lo:101: 00010000:00010000:2.0:1787856616.292054:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856616.292065:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c36ec expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.292086:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.292095:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.292103:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000246d2fbd, rc 0) 00000100:00100000:2.0:1787856616.292143:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000254e47b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:7426:x1874703436225280:12345-0@lo:101: Request processed in 99us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.292149:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856616.292334:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6cf4e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225280:0@lo:101: 00010000:00010000:3.0:1787856616.292347:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856616.292354:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856616.292470:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6cf4e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225408:0@lo:501: 00000100:00100000:3.0:1787856616.292503:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856616.292524:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cce33848 going to sleep for 11 seconds 00000100:00100000:2.0:1787856616.292581:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436225408 00000100:00100000:2.0:1787856616.292595:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436225408 00000100:00100000:2.0:1787856616.292614:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787856616.292619:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2a02ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:7426:x1874703436225408:12345-0@lo:501: 00000100:00100000:2.0:1787856616.292733:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2a02ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:7426:x1874703436225408:12345-0@lo:501: Request processed in 113us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.292740:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856616.292874:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6cf4e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225408:0@lo:501: 00000100:00100000:3.0:1787856616.292910:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6cf4e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225536:0@lo:503: 00000100:00100000:3.0:1787856616.292952:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856616.292984:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cce33848 going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.293051:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436225536 00000100:00100000:0.0:1787856616.293056:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436225536 00000100:00100000:0.0:1787856616.293089:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787856616.293094:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cbc9ef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+14:7426:x1874703436225536:12345-0@lo:503: 00000040:00080000:0.0:1787856616.293128:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787856616.293201:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cbc9ef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+14:7426:x1874703436225536:12345-0@lo:503: Request processed in 107us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.293209:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856616.293920:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6cf4e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225536:0@lo:503: 00000040:00080000:3.0:1787856616.294278:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856616.294335:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787856616.294408:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856616.296253:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00080000:0.0:1787856616.296525:0:6501:0:(import.c:65:import_set_state_nolock()) 00000000bf48a0f5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856616.296633:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a8f7cde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1874703436224768:12345-0@lo:38: Request processed in 10198us (10498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.296648:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856616.296692:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787856616.296702:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787856616.296710:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787856616.296715:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787856616.296717:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000a7cedd31 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787856616.296738:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bad9ddb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436224768:0@lo:38: 00000100:00100000:3.0:1787856616.296889:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d84fa968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436225664:0@lo:41: 00000100:00100000:3.0:1787856616.296928:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856616.297020:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436225664 00000100:00100000:1.0:1787856616.297028:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436225664 00000100:00100000:1.0:1787856616.297068:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856616.297076:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6cf4e4b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436225664:12345-0@lo:41: 00000004:00000024:1.0:1787856616.297101:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787856616.297141:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6cf4e4b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436225664:12345-0@lo:41: Request processed in 67us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856616.297147:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856616.297160:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d84fa968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436225664:0@lo:41: 00000020:01000000:2.0:1787856616.297265:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787856616.297295:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787856616.297311:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.297321:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856616.297377:0:7426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787856616.297379:0:7426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9065f7199800 10000000:01000000:2.0:1787856616.297382:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9065f7199800 10000000:01000000:2.0:1787856616.297386:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787856616.297392:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065f7199800 from 1 10000000:01000000:2.0:1787856616.297395:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787856616.297421:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.297428:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.297436:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.297450:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8f0caa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225792:0@lo:101: 00000100:00100000:2.0:1787856616.297490:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.297520:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f440d63a going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.297576:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436225792 00000100:00100000:0.0:1787856616.297581:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436225792 00000100:00100000:0.0:1787856616.298019:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787856616.298028:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c58abe98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:7426:x1874703436225792:12345-0@lo:101: 00010000:00010000:0.0:1787856616.298038:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856616.298051:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c36fa expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.298075:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.298096:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.298105:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010e9bf8f, rc 0) 00000100:00100000:0.0:1787856616.298152:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c58abe98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436225792:12345-0@lo:101: Request processed in 126us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.298159:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787856616.298261:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8f0caa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225792:0@lo:101: 00010000:00010000:2.0:1787856616.298275:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.298283:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.298370:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8f0caa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225920:0@lo:501: 00000100:00100000:2.0:1787856616.298399:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.300692:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f440d63a going to sleep for 11 seconds 00000100:00100000:1.0:1787856616.301146:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436225920 00000100:00100000:1.0:1787856616.301194:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436225920 00000100:00100000:1.0:1787856616.301277:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787856616.301285:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b632e2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436225920:12345-0@lo:501: 00000100:00100000:1.0:1787856616.301450:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b632e2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436225920:12345-0@lo:501: Request processed in 166us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856616.301457:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787856616.301687:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8f0caa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436225920:0@lo:501: 00000100:00100000:2.0:1787856616.301742:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8f0caa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436226048:0@lo:503: 00000100:00100000:2.0:1787856616.301810:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.301881:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f440d63a going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.301924:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436226048 00000100:00100000:0.0:1787856616.301930:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436226048 00000100:00100000:0.0:1787856616.301965:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787856616.301971:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e863e243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436226048:12345-0@lo:503: 00000100:00100000:0.0:1787856616.302061:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e863e243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436226048:12345-0@lo:503: Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.302068:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787856616.302150:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8f0caa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436226048:0@lo:503: 00000040:00080000:2.0:1787856616.302477:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787856616.302564:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8f0caa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436226176:0@lo:502: 00000100:00100000:2.0:1787856616.302610:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.302627:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086e0eec6 going to sleep for 11 seconds 00000100:00100000:0.0:1787856616.302901:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436226176 00000100:00100000:0.0:1787856616.302906:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436226176 00000100:00100000:0.0:1787856616.302948:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787856616.302955:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073431a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436226176:12345-0@lo:502: 00000100:00100000:0.0:1787856616.303137:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073431a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436226176:12345-0@lo:502: Request processed in 182us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.303144:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787856616.303782:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8f0caa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436226176:0@lo:502: 00000040:00080000:3.0:1787856616.304058:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787856616.304103:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787856616.304126:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787856616.304139:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787856616.304151:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787856616.304163:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787856616.304187:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787856616.304201:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787856616.304354:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787856616.304376:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787856616.304389:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787856616.304400:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787856616.304411:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787856616.304424:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787856616.304436:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787856616.304460:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787856616.304473:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787856616.304485:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787856616.304496:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787856616.304506:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787856616.304517:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787856616.304528:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787856616.304539:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787856616.304551:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787856616.304564:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787856616.304577:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787856616.304715:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787856616.304734:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787856616.304777:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d682760d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436226304:0@lo:502: 00000100:00100000:3.0:1787856616.304836:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856616.304939:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8a8f5e2 going to sleep for 11 seconds 00000100:00100000:1.0:1787856616.305007:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436226304 00000100:00100000:1.0:1787856616.305014:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436226304 00000100:00100000:1.0:1787856616.305096:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787856616.305104:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5fdec16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436226304:12345-0@lo:502: 00000100:00100000:3.0:1787856616.305361:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d682760d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436226304:0@lo:502: 00000040:00080000:3.0:1787856616.305411:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787856616.305420:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:1.0:1787856616.305660:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5fdec16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436226304:12345-0@lo:502: Request processed in 484us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856616.305669:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000020:01000004:3.0:1787856616.306078:0:7444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787856616.306093:0:7444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000c8fb5f44) 00000020:00000080:3.0:1787856616.306113:0:7444:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787856616.306354:0:7444:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008065a073 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787856616.306402:0:7444:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008065a073 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787856616.306406:0:7444:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008065a073 3 00010000:00080000:2.0:1787856616.306438:0:7444:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a52a9086@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1787856616.308412:0:7444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1787856616.308889:0:7444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787856616.308958:0:7444:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787856616.308972:0:7444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc25410d92a3c370f 00000100:00080000:2.0:1787856616.308985:0:7444:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787856616.308991:0:7444:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000a52a9086 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856616.309036:0:7444:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000022a29e85 x1874703436226432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787856616.309068:0:7444:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787856616.309333:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022a29e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874703436226432:0@lo:38: 00000100:00100000:0.0:1787856616.309415:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.309513:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8aae28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436226560:0@lo:400: 00000100:00100000:0.0:1787856616.309539:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.309585:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436226432 00000100:00100000:0.0:1787856616.309676:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436226432 00000100:00100000:0.0:1787856616.309705:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436226560 00000100:00100000:0.0:1787856616.309709:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436226560 00000100:00100000:0.0:1787856616.309732:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856616.309739:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bad9ddb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436226560:12345-0@lo:400: 00000100:00100000:0.0:1787856616.309804:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bad9ddb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436226560:12345-0@lo:400: Request processed in 65us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.309811:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856616.309828:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787856616.309831:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057286467 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874703436226432:12345-0@lo:38: 00010000:00080000:0.0:1787856616.309850:0:6498:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:0.0:1787856616.309883:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc25410d92a3c3716 00000004:00100000:0.0:1787856616.309897:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787856616.309926:0:6498:0:(import.c:65:import_set_state_nolock()) 00000000367e70bf : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856616.309964:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057286467 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874703436226432:12345-0@lo:38: Request processed in 132us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856616.309971:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787856616.310009:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002a8aae28 x1874703436226560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856616.310025:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8aae28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436226560:0@lo:400: 00010000:00080000:0.0:1787856616.310052:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000022a29e85 x1874703436226432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856616.310059:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787856616.310065:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787856616.310072:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787856616.310076:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787856616.310084:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000a52a9086 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787856616.310090:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022a29e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874703436226432:0@lo:38: 00000040:00080000:2.0:1787856616.310553:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1787856616.310848:0:7445:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1787856616.310953:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787856616.310986:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787856616.311007:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.311019:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787856616.311065:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787856616.311068:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787856616.311069:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856616.311070:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856616.311072:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856616.311074:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856616.311075:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787856616.311078:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787856616.311079:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787856616.311080:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856616.311083:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787856616.311086:0:7426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1787856616.311089:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787856616.311090:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787856616.311092:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856616.311093:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856616.311094:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856616.311096:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856616.311096:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787856616.311097:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787856616.311098:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787856616.311099:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856616.311100:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787856616.311118:0:7426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787856616.311132:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8aae28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436226688:0@lo:253: 00000100:00100000:0.0:1787856616.311197:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.311413:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f1d230d going to sleep for 11 seconds 00000100:00100000:1.0:1787856616.313847:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436226688 00000100:00100000:1.0:1787856616.313873:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436226688 00000100:00100000:1.0:1787856616.313947:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787856616.313957:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063ee9cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436226688:12345-0@lo:253: 20000000:01000000:1.0:1787856616.313995:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787856616.314012:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787856616.323864:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787856616.324018:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787856616.324063:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787856616.324410:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063ee9cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:7426:x1874703436226688:12345-0@lo:253: Request processed in 10451us (13210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856616.324424:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787856616.324608:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8aae28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:7426:1874703436226688:0@lo:253: 10000000:01000000:3.0:1787856616.324624:0:7426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787856616.324628:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787856616.324630:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787856616.324631:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856616.324632:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856616.324633:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856616.324635:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856616.324636:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787856616.324638:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787856616.324639:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787856616.324641:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856616.324642:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787856616.324659:0:7426:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787856616.329095:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787856616.329107:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787856616.329137:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.329157:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.329164:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c36de expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.329170:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.329243:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c36de expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.329261:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c36de expref: 14 pid: 6491 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.329275:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2fa99be pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436226816:0@lo:104: 00000100:00100000:0.0:1787856616.329346:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856616.329403:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856616.329411:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 14 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856616.329440:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d9c24c1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436226944:0@lo:104: 00000100:00100000:0.0:1787856616.329461:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856616.329485:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 0000000027cdfc70 going to sleep for 11 seconds 00000100:00100000:2.0:1787856616.329607:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436226816 00000100:00100000:2.0:1787856616.329615:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436226816 00000100:00100000:2.0:1787856616.329654:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436226944 00000100:00100000:2.0:1787856616.329657:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436226944 00000100:00100000:2.0:1787856616.329670:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856616.329678:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000445f4d4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:6512:x1874703436226816:12345-0@lo:104: 00010000:00010000:2.0:1787856616.329688:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329766:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787856616.329771:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000445f4d4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:6512:x1874703436226816:12345-0@lo:104: Request processed in 94us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.329778:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856616.329795:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856616.329800:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecbb0500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:6512:x1874703436226944:12345-0@lo:104: 00010000:00010000:2.0:1787856616.329807:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329838:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787856616.329843:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecbb0500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:6512:x1874703436226944:12345-0@lo:104: Request processed in 43us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.329856:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787856616.329871:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787856616.329877:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329884:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f320ba2 already unused, calling callback (00000000f3ade360) 10000000:00010000:2.0:1787856616.329887:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329894:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856616.329900:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856616.329905:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787856616.329930:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329937:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856616.329955:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329960:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 000000003f320ba2/0xc25410d92a3c36de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c36e5 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329971:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856616.329973:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329988:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e445b3f8 already unused, calling callback (00000000f3ade360) 10000000:00010000:2.0:1787856616.329990:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.329996:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856616.330001:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856616.330005:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787856616.330019:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330024:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856616.330029:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330034:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 00000000e445b3f8/0xc25410d92a3c3636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c363d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330048:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856616.330049:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856616.330051:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856616.330058:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856616.330076:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436227072:0@lo:103: 00000100:00100000:2.0:1787856616.330107:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.330129:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856616.330134:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022a29e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436227200:0@lo:103: 00000100:00100000:2.0:1787856616.330164:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.330194:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436227072 00000100:00100000:2.0:1787856616.330198:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436227072 00010000:00010000:2.0:1787856616.330212:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c36de expref: 15 pid: 6491 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.330253:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436227200 00000100:00100000:2.0:1787856616.330256:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436227200 00010000:00010000:2.0:1787856616.330265:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 16 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.330276:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856616.330281:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8f0caa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3625:x1874703436227072:12345-0@lo:103: 00010000:00010000:2.0:1787856616.330291:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856616.330294:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c36de expref: 16 pid: 6491 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330303:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c36de expref: 16 pid: 6491 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330317:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856616.330342:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8f0caa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3625:x1874703436227072:12345-0@lo:103: Request processed in 61us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.330349:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856616.330362:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856616.330367:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f402e496 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+15:3625:x1874703436227200:12345-0@lo:103: 00010000:00010000:2.0:1787856616.330374:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856616.330378:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 15 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330396:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 15 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330408:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330416:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787856616.330429:0:6483:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001322849s 00010000:00010000:2.0:1787856616.330433:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330439:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330445:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330451:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330457:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d16d0bfc already unused, calling callback (00000000c3795dd1) 00010000:00010000:2.0:1787856616.330460:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330467:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330475:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330493:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856616.330514:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f402e496 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+15:3625:x1874703436227200:12345-0@lo:103: Request processed in 148us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.330520:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856616.330584:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022a29e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436227200:0@lo:103: 00000100:00100000:2.0:1787856616.330593:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436227072:0@lo:103: 00010000:00010000:2.0:1787856616.330618:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f11bd0be/0xc25410d92a3c36e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c36de expref: 14 pid: 6491 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.330628:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2fa99be pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436226816:0@lo:104: 00010000:00010000:2.0:1787856616.330635:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c352ba06/0xc25410d92a3c363d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3636 expref: 13 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856616.330642:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d9c24c1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436226944:0@lo:104: 00010000:00010000:2.0:1787856616.330653:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330661:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330666:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856616.330671:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d16d0bfc/0xc25410d92a3c371d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787856616.336605:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1787856616.336850:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787856616.337085:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787856616.337520:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787856616.337650:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787856616.337783:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787856616.338823:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787856616.339277:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787856616.339464:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1787856616.339625:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787856616.339821:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1787856616.340305:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1787856616.343000:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787856616.343120:0:7449:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787856616.343124:0:7449:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787856616.343667:0:7450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1787856616.343724:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7450:1874703436227328:0@lo:700: 00000100:00100000:2.0:1787856616.343875:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.343929:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000083efb8f9 going to sleep for 11 seconds 00000100:00100000:3.0:1787856616.343944:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436227328 00000100:00100000:3.0:1787856616.343951:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436227328 00000040:01000000:0.0:1787856616.343964:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787856616.344015:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856616.344024:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022a29e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7450:x1874703436227328:12345-0@lo:700: 00000100:00100000:3.0:1787856616.344467:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d682760d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436227456:0@lo:1000: 00000100:00100000:3.0:1787856616.344501:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856616.344535:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a5a8fde going to sleep for 11 seconds 00000100:00100000:1.0:1787856616.344845:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436227456 00000100:00100000:1.0:1787856616.344851:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436227456 00000100:00100000:1.0:1787856616.344890:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856616.344897:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009983ce9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436227456:12345-0@lo:1000: 00000100:00100000:1.0:1787856616.344981:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009983ce9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436227456:12345-0@lo:1000: Request processed in 85us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856616.344989:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787856616.345084:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d682760d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436227456:0@lo:1000: 00000040:01000000:2.0:1787856616.345119:0:7451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1787856616.345143:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d59811ae pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436227584:0@lo:700: 00000100:00100000:2.0:1787856616.345173:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.345407:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9bcd528 going to sleep for 11 seconds 00000040:01000000:0.0:1787856616.345467:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787856616.345611:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787856616.346162:0:7426:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787856616.346171:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787856616.346459:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856616.347366:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436227584 00000100:00100000:1.0:1787856616.347375:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436227584 00000100:00100000:1.0:1787856616.347463:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787856616.347473:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8f0caa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436227584:12345-0@lo:700: 00000100:00100000:1.0:1787856616.347571:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8f0caa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436227584:12345-0@lo:700: Request processed in 100us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856616.347578:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856616.347848:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d59811ae pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436227584:0@lo:700: 00000100:00100000:3.0:1787856616.347918:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6d19fb7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7451:1874703436227712:0@lo:900: 00000100:00100000:3.0:1787856616.347959:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856616.347991:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436227712 00000100:00100000:3.0:1787856616.347995:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436227712 00000100:00100000:3.0:1787856616.348031:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856616.348038:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d682760d pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7451:x1874703436227712:12345-0@lo:900: 00000100:00100000:3.0:1787856616.348073:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d682760d pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7451:x1874703436227712:12345-0@lo:900: Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856616.348087:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856616.348108:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d56d414e going to sleep for 11 seconds 00010000:00080000:3.0:1787856616.348123:0:7451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a6d19fb7 x1874703436227712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787856632 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856616.348133:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6d19fb7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7451:1874703436227712:0@lo:900: 00000100:00100000:3.0:1787856616.348241:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6d19fb7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436227840:0@lo:1000: 00000100:00100000:3.0:1787856616.348272:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856616.348289:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 000000001436c3f7 going to sleep for 11 seconds 00000040:00080000:0.0:1787856616.348588:0:7426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1787856616.349317:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436227840 00000100:00100000:2.0:1787856616.349324:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436227840 00000100:00100000:2.0:1787856616.349365:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856616.349371:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7cb8855 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436227840:12345-0@lo:1000: 00000100:00100000:2.0:1787856616.349452:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7cb8855 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436227840:12345-0@lo:1000: Request processed in 81us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856616.349459:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856616.349551:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6d19fb7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436227840:0@lo:1000: 00000004:00080000:3.0:1787856616.349608:0:7451:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d56d414e with version 0 00000020:00100000:3.0:1787856616.349627:0:7451:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787856616.349633:0:7451:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a6d19fb7 x1874703436228096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787856616.349648:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6d19fb7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436228096:0@lo:1000: 00000100:00100000:3.0:1787856616.349676:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856616.349694:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436228096 00000100:00100000:2.0:1787856616.349698:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436228096 00000100:00100000:3.0:1787856616.349703:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 000000008162c944 going to sleep for 11 seconds 00000100:00100000:2.0:1787856616.349723:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856616.349728:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a870969b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436228096:12345-0@lo:1000: 00000040:00080000:0.0:1787856616.349949:0:7426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787856616.350006:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787856616.350186:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787856616.350410:0:7426:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787856616.351066:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787856616.351205:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787856616.351377:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787856616.351512:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787856616.351654:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787856616.351860:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787856616.352003:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 40000000:02000000:3.0:1787856616.352928:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000001:00080000:1.0:1787856616.356396:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:0.0:1787856616.356496:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787856616.356883:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787856616.357020:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787856616.357174:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787856616.357344:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787856616.357502:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787856616.357641:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000100:00100000:3.0:1787856616.362486:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022a29e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7450:x1874703436227328:12345-0@lo:700: Request processed in 18454us (18602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856616.362504:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:0.0:1787856616.362780:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787856616.363057:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787856616.363408:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787856616.363594:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787856616.363729:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787856616.363893:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787856616.364039:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787856616.364177:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787856616.364370:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787856616.364517:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787856616.364669:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787856616.364815:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787856616.364951:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787856616.365104:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787856616.365267:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787856616.365391:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787856616.365519:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787856616.365675:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00010000:00080000:2.0:1787856616.367505:0:7450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008a4fddfa x1874703436227328/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787856632 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856616.367525:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7450:1874703436227328:0@lo:700: 40000000:02000000:2.0:1787856616.367539:0:7450:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00000004:0.0:1787856616.371911:0:7426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787856616.373233:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a870969b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436228096:12345-0@lo:1000: Request processed in 23484us (23536us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787856616.373261:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1787856616.373428:0:7451:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787856616.373434:0:7451:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787856616.373451:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6d19fb7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436228096:0@lo:1000: 00000100:00100000:1.0:1787856616.373550:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080b0f780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436228224:0@lo:1000: 00000100:00100000:1.0:1787856616.373592:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856616.373646:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5897d8d going to sleep for 11 seconds 00000100:00100000:3.0:1787856616.373706:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436228224 00000100:00100000:3.0:1787856616.373713:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436228224 00000100:00100000:3.0:1787856616.373772:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856616.373780:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b67863e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436228224:12345-0@lo:1000: 00000100:00100000:3.0:1787856616.373859:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b67863e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1874703436228224:12345-0@lo:1000: Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856616.373866:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787856616.373937:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080b0f780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1874703436228224:0@lo:1000: 00000040:00080000:0.0:1787856616.373955:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787856616.373986:0:7451:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003303a53c with version 1 00000040:00080000:0.0:1787856616.376075:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787856616.376178:0:7451:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787856616.376393:0:7441:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000000af20150 version 1 rpc_version 1 00000020:00100000:3.0:1787856616.376435:0:7441:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787856616.376444:0:7441:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000066ca5d23 x1874703436228480/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787856616.376468:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7441:1874703436228480:0@lo:1000: 00000100:00100000:3.0:1787856616.376545:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856616.376603:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000392372d0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856616.376689:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436228480 00000100:00100000:1.0:1787856616.376698:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436228480 00000100:00100000:1.0:1787856616.376740:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787856616.376749:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000510aa248 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7441:x1874703436228480:12345-0@lo:1000: 00000001:00080000:2.0:1787856616.383198:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1787856616.383603:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000510aa248 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7441:x1874703436228480:12345-0@lo:1000: Request processed in 6851us (7055us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787856616.383617:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1787856616.384108:0:7441:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787856616.384114:0:7441:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787856616.384132:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7441:1874703436228480:0@lo:1000: 00000001:00080000:1.0:1787856616.384256:0:7426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787856616.384291:0:7426:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae99c2247988 00100000:10000000:1.0:1787856616.384298:0:7426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787856616.387611:0:7426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787856616.387646:0:7426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787856616.387667:0:7426:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787856616.387693:0:7426:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787856616.388657:0:7426:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856616.390665:0:7426:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1787856616.434303:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787856616.437876:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787856616.437976:0:7450:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787856616.437983:0:7450:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1787856617.298262:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856618.328413:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856619.355638:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856620.369510:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787856621.066454:0:7695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787856621.393421:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002b902e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436228608:0@lo:400: 00000100:00100000:0.0:1787856621.393510:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856621.393578:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856621.393585:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436228736:0@lo:400: 00000100:00100000:0.0:1787856621.393611:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856621.393650:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436228608 00000100:00100000:0.0:1787856621.393657:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436228608 00000100:00100000:0.0:1787856621.393717:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787856621.393725:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003552edef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+13:3623:x1874703436228608:12345-0@lo:400: 00000100:00100000:0.0:1787856621.393789:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003552edef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+13:3623:x1874703436228608:12345-0@lo:400: Request processed in 65us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856621.393797:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787856621.393833:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436228736 00000100:00100000:0.0:1787856621.393837:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436228736 00000100:00100000:0.0:1787856621.393866:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787856621.393871:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011bc5800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436228736:12345-0@lo:400: 00000100:00100000:0.0:1787856621.393903:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011bc5800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436228736:12345-0@lo:400: Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856621.393909:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787856621.393946:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a13bf411 x1874703436228736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856621.393961:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436228736:0@lo:400: 00000100:00100000:0.0:1787856621.393970:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002b902e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436228608:0@lo:400: 00010000:00010000:3.0:1787856621.394209:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856621.394237:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787856621.394248:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009aa5147d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436229120:0@lo:41: 00000100:00100000:3.0:1787856621.394281:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856621.394310:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436229120 00000100:00100000:3.0:1787856621.394315:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436229120 00000100:00100000:3.0:1787856621.394344:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856621.394350:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5cb0cc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436229120:12345-0@lo:41: 00000004:00000024:3.0:1787856621.394393:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787856621.394436:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5cb0cc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436229120:12345-0@lo:41: Request processed in 87us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856621.394442:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856621.394475:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009aa5147d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436229120:0@lo:41: 00000100:00100000:2.0:1787856621.394848:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d9c24c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436228864:0@lo:400: 00000100:00100000:2.0:1787856621.394881:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856621.394900:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856621.394906:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2fa99be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436228992:0@lo:400: 00000100:00100000:2.0:1787856621.394928:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856621.395098:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436228864 00000100:00100000:3.0:1787856621.395102:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436228864 00000100:00100000:3.0:1787856621.395155:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856621.395163:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065e06cd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436228864:12345-0@lo:400: 00000100:00100000:3.0:1787856621.395200:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065e06cd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436228864:12345-0@lo:400: Request processed in 39us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856621.395206:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787856621.395344:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d9c24c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436228864:0@lo:400: 00000100:00100000:0.0:1787856621.396206:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436228992 00000100:00100000:0.0:1787856621.396212:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436228992 00000100:00100000:0.0:1787856621.396271:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787856621.396278:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000119f59cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436228992:12345-0@lo:400: 00000100:00100000:0.0:1787856621.396331:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000119f59cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436228992:12345-0@lo:400: Request processed in 54us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856621.396338:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787856621.396549:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e2fa99be x1874703436228992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856621.396563:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2fa99be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436228992:0@lo:400: 00000020:00000004:2.0:1787856622.181192:0:7747:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856622.183576:0:7747:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787856622.419280:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856623.442412:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856624.466479:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787856625.083602:0:7849:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787856625.083880:0:7849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787856625.489377:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787856626.001313:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787856626.001322:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065f7199800 from 4 10000000:01000000:2.0:1787856626.001326:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787856626.001375:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000f9420bf9/0xc25410d92a3c3724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.001389:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000f9420bf9/0xc25410d92a3c3724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.001400:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000f9420bf9/0xc25410d92a3c3724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.001424:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229248:0@lo:101: 00000100:00100000:2.0:1787856626.001499:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.001566:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037a9a3fb going to sleep for 11 seconds 00000100:00100000:3.0:1787856626.002370:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436229248 00000100:00100000:3.0:1787856626.002377:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436229248 00000100:00100000:3.0:1787856626.002547:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787856626.002555:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6cc8cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+13:6493:x1874703436229248:12345-0@lo:101: 00010000:00010000:3.0:1787856626.002569:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856626.002583:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000589e42ad/0xc25410d92a3c372b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3724 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.002606:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000589e42ad/0xc25410d92a3c372b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.002626:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000589e42ad/0xc25410d92a3c372b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.002634:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000589e42ad, rc 0) 00000100:00100000:3.0:1787856626.002760:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6cc8cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436229248:12345-0@lo:101: Request processed in 206us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856626.002767:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787856626.002870:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229248:0@lo:101: 00010000:00010000:2.0:1787856626.004057:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000f9420bf9/0xc25410d92a3c3724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.004073:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000f9420bf9/0xc25410d92a3c3724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.004135:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229376:0@lo:256: 00000100:00100000:2.0:1787856626.004200:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.013168:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037a9a3fb going to sleep for 11 seconds 00000100:00100000:0.0:1787856626.015168:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436229376 00000100:00100000:0.0:1787856626.015185:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436229376 00000100:00100000:0.0:1787856626.015263:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787856626.015273:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069a486bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436229376:12345-0@lo:256: 20000000:01000000:0.0:1787856626.015303:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787856626.015325:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787856626.015328:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787856626.015473:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069a486bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436229376:12345-0@lo:256: Request processed in 201us (11272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.015481:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787856626.016561:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229376:0@lo:256: 10000000:01000000:2.0:1787856626.016622:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787856626.016630:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000f9420bf9/0xc25410d92a3c3724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.016640:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000f9420bf9/0xc25410d92a3c3724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856626.016736:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787856626.016738:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065d3be8000 from 21 10000000:01000000:2.0:1787856626.016741:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787856626.016771:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.016778:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.016785:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.016802:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229504:0@lo:101: 00000100:00100000:2.0:1787856626.016992:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.017070:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037a9a3fb going to sleep for 11 seconds 00000100:00100000:1.0:1787856626.017110:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436229504 00000100:00100000:1.0:1787856626.017115:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436229504 00000100:00100000:1.0:1787856626.017343:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787856626.017353:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b316ab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436229504:12345-0@lo:101: 00010000:00010000:1.0:1787856626.017364:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856626.017375:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3732 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856626.017397:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856626.017406:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856626.017414:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009f54b6e6, rc 0) 00000100:00100000:1.0:1787856626.017460:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b316ab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436229504:12345-0@lo:101: Request processed in 109us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856626.017466:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787856626.017537:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229504:0@lo:101: 00010000:00010000:2.0:1787856626.017550:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.017558:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.017615:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229632:0@lo:501: 00000100:00100000:2.0:1787856626.017641:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.017759:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037a9a3fb going to sleep for 11 seconds 00000100:00100000:2.0:1787856626.017769:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436229632 00000100:00100000:2.0:1787856626.017773:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436229632 00000100:00100000:2.0:1787856626.017831:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787856626.017852:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d73af6a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436229632:12345-0@lo:501: 00000100:00100000:2.0:1787856626.017975:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d73af6a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436229632:12345-0@lo:501: Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.017982:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787856626.018478:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229632:0@lo:501: 00000100:00100000:2.0:1787856626.018508:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229760:0@lo:503: 00000100:00100000:2.0:1787856626.018550:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.018611:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037a9a3fb going to sleep for 11 seconds 00000100:00100000:1.0:1787856626.018720:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436229760 00000100:00100000:1.0:1787856626.018725:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436229760 00000100:00100000:1.0:1787856626.018762:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787856626.018768:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007863bced pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436229760:12345-0@lo:503: 00000100:00100000:1.0:1787856626.019060:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007863bced pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436229760:12345-0@lo:503: Request processed in 292us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856626.019068:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787856626.019125:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436229760:0@lo:503: 00000100:00100000:3.0:1787856626.019551:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:7890:1874703436229888:0@lo:502: 00000100:00100000:3.0:1787856626.019586:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.019626:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436229888 00000100:00100000:2.0:1787856626.019632:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436229888 00000100:00100000:2.0:1787856626.019743:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787856626.019751:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000439cc91a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:7890:x1874703436229888:12345-0@lo:502: 00000100:00100000:2.0:1787856626.020025:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000439cc91a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:7890:x1874703436229888:12345-0@lo:502: Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.020033:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787856626.025517:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089c42092 going to sleep for 11 seconds 00000100:00100000:3.0:1787856626.025566:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:7890:1874703436229888:0@lo:502: 00000100:00100000:3.0:1787856626.025705:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:7890:1874703436230016:0@lo:502: 00000100:00100000:3.0:1787856626.025784:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.025827:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436230016 00000100:00100000:3.0:1787856626.025833:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436230016 00000100:00100000:3.0:1787856626.026053:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787856626.026063:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003650193a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:7890:x1874703436230016:12345-0@lo:502: 00000100:00100000:3.0:1787856626.026199:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003650193a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:7890:x1874703436230016:12345-0@lo:502: Request processed in 138us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856626.026208:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787856626.026287:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089c42092 going to sleep for 11 seconds 00000100:00100000:3.0:1787856626.026301:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:7890:1874703436230016:0@lo:502: 00000040:00080000:3.0:1787856626.026321:0:7890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787856626.026673:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787856626.026697:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787856626.026706:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.026716:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856626.026725:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787856626.026728:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065d3be8000 from 4 10000000:01000000:2.0:1787856626.026731:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787856626.026761:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000d4e79d3f/0xc25410d92a3c3740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.026768:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000d4e79d3f/0xc25410d92a3c3740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.026776:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000d4e79d3f/0xc25410d92a3c3740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.026791:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230144:0@lo:101: 00000100:00100000:2.0:1787856626.026823:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.026866:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ed2f43e going to sleep for 11 seconds 00000100:00100000:3.0:1787856626.027078:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436230144 00000100:00100000:3.0:1787856626.027084:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436230144 00000100:00100000:3.0:1787856626.027122:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787856626.027130:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004da88b11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436230144:12345-0@lo:101: 00010000:00010000:3.0:1787856626.027139:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856626.027152:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c352ba06/0xc25410d92a3c3747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3740 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.027173:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c352ba06/0xc25410d92a3c3747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.027184:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c352ba06/0xc25410d92a3c3747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.027201:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c352ba06, rc 0) 00000100:00100000:3.0:1787856626.027254:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004da88b11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436230144:12345-0@lo:101: Request processed in 125us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856626.027385:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787856626.027425:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230144:0@lo:101: 00010000:00010000:3.0:1787856626.027437:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000d4e79d3f/0xc25410d92a3c3740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.027444:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000d4e79d3f/0xc25410d92a3c3740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856626.027489:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230272:0@lo:256: 00000100:00100000:3.0:1787856626.027519:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.027550:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e70af56 going to sleep for 11 seconds 00000100:00100000:2.0:1787856626.027731:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436230272 00000100:00100000:2.0:1787856626.027736:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436230272 00000100:00100000:2.0:1787856626.027768:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787856626.027775:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b7ee63f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436230272:12345-0@lo:256: 20000000:01000000:2.0:1787856626.027789:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787856626.027804:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787856626.027807:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787856626.028021:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b7ee63f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436230272:12345-0@lo:256: Request processed in 246us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.028028:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787856626.028097:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230272:0@lo:256: 10000000:01000000:3.0:1787856626.028141:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787856626.028147:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000d4e79d3f/0xc25410d92a3c3740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.028154:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000d4e79d3f/0xc25410d92a3c3740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856626.028162:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787856626.028164:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787856626.028166:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787856626.028194:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.028207:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.028245:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856626.028375:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230400:0@lo:101: 00000100:00100000:3.0:1787856626.028406:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.028436:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e70af56 going to sleep for 11 seconds 00000100:00100000:2.0:1787856626.028474:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436230400 00000100:00100000:2.0:1787856626.028479:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436230400 00000100:00100000:2.0:1787856626.028512:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787856626.028518:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8db95bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436230400:12345-0@lo:101: 00010000:00010000:2.0:1787856626.028525:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856626.028534:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c374e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.028560:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c374e expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.028567:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c374e expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.028574:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f320ba2, rc 0) 00000100:00100000:2.0:1787856626.028600:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8db95bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436230400:12345-0@lo:101: Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.028606:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787856626.028742:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230400:0@lo:101: 00010000:00010000:3.0:1787856626.028753:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.028762:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856626.028814:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230528:0@lo:501: 00000100:00100000:3.0:1787856626.028976:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.029000:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e70af56 going to sleep for 11 seconds 00000100:00100000:2.0:1787856626.029043:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436230528 00000100:00100000:2.0:1787856626.029047:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436230528 00000100:00100000:2.0:1787856626.029078:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787856626.029083:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9e8516a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436230528:12345-0@lo:501: 00000100:00100000:2.0:1787856626.029184:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9e8516a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436230528:12345-0@lo:501: Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.029191:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787856626.029746:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230528:0@lo:501: 00000100:00100000:3.0:1787856626.029783:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230656:0@lo:503: 00000100:00100000:3.0:1787856626.029825:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.029999:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e70af56 going to sleep for 11 seconds 00000100:00100000:2.0:1787856626.030130:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436230656 00000100:00100000:2.0:1787856626.030135:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436230656 00000100:00100000:2.0:1787856626.030161:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787856626.030167:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd2e0186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436230656:12345-0@lo:503: 00000100:00100000:2.0:1787856626.030377:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd2e0186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436230656:12345-0@lo:503: Request processed in 209us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.030384:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787856626.031506:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436230656:0@lo:503: 00000100:00100000:1.0:1787856626.034137:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:7893:1874703436230784:0@lo:502: 00000100:00100000:1.0:1787856626.034232:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856626.034281:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c49393f2 going to sleep for 11 seconds 00000100:00100000:2.0:1787856626.034393:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436230784 00000100:00100000:2.0:1787856626.034400:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436230784 00000100:00100000:2.0:1787856626.034481:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787856626.034497:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ddf5b07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:7893:x1874703436230784:12345-0@lo:502: 00000100:00100000:2.0:1787856626.034626:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ddf5b07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:7893:x1874703436230784:12345-0@lo:502: Request processed in 130us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.034634:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787856626.034724:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:7893:1874703436230784:0@lo:502: 00000020:01000000:1.0:1787856626.034754:0:7893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856626.034766:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856626.034769:0:7893:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787856626.034778:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787856626.034782:0:7893:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:1.0:1787856626.034806:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787856626.034820:0:7893:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000022522f4e) 00000020:00000080:1.0:1787856626.034837:0:7893:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787856626.034843:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787856626.034920:0:7893:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787856626.034925:0:7893:0:(osd_handler.c:8928:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787856626.034934:0:7893:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c3763 00010000:00080000:1.0:1787856626.034965:0:7893:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d3ac27a9@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1787856626.040171:0:7893:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787856626.047304:0:7893:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787856626.047322:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787856626.047356:0:7893:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787856626.047390:0:7893:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c376a 00000100:00080000:1.0:1787856626.047401:0:7893:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856626.047406:0:7893:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d3ac27a9 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856626.047442:0:7893:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007cf438ad x1874703436230912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856626.047470:0:7893:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787856626.047509:0:7893:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787856626.047864:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436230912:0@lo:38: 00000100:00100000:3.0:1787856626.047924:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856626.047936:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6d19fb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436231040:0@lo:400: 00000100:00100000:2.0:1787856626.048008:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.048092:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.048132:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436231168:0@lo:400: 00000100:00100000:3.0:1787856626.048158:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.048187:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856626.048192:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2c8b0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436231296:0@lo:400: 00000100:00100000:3.0:1787856626.048214:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.048267:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436230912 00000100:00100000:3.0:1787856626.048273:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436230912 00000100:00100000:3.0:1787856626.048296:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436231168 00000100:00100000:3.0:1787856626.048299:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436231168 00000100:00100000:3.0:1787856626.048322:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856626.048328:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d59811ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436230912:12345-0@lo:38: 00010000:00080000:3.0:1787856626.048352:0:6501:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:3.0:1787856626.048525:0:6501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c3771 00000004:00100000:3.0:1787856626.048541:0:6501:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787856626.048547:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787856626.048598:0:7899:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000008a4fddfa x1874703436231424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856626.048608:0:7899:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef5540b0 going to sleep for 0 seconds 00000020:01000000:1.0:1787856626.048758:0:7893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856626.048764:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856626.048767:0:7893:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787856626.048769:0:7893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856626.048773:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856626.048774:0:7893:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787856626.048777:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787856626.048778:0:7893:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787856626.048798:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091693c6d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:7893:1874703436231552:0@lo:502: 00000100:00100000:1.0:1787856626.048843:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856626.048871:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 00000000799b472e going to sleep for 11 seconds 00000100:00100000:3.0:1787856626.048911:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436231040 00000100:00100000:3.0:1787856626.048915:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436231040 00000100:00100000:3.0:1787856626.048950:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436231296 00000100:00100000:3.0:1787856626.048954:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436231296 00000100:00100000:0.0:1787856626.048974:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787856626.048984:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084c776bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436231040:12345-0@lo:400: 00000100:00100000:0.0:1787856626.049047:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084c776bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436231040:12345-0@lo:400: Request processed in 65us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.049054:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787856626.049075:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a6d19fb7 x1874703436231040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856626.049089:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6d19fb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436231040:0@lo:400: 00000100:00100000:3.0:1787856626.049151:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856626.049158:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b50dd6af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436231296:12345-0@lo:400: 00000100:00100000:3.0:1787856626.049202:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b50dd6af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436231296:12345-0@lo:400: Request processed in 46us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856626.049209:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787856626.049351:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f2c8b0e0 x1874703436231296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856626.049362:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2c8b0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436231296:0@lo:400: 00000100:00100000:2.0:1787856626.049463:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436231552 00000100:00100000:2.0:1787856626.049468:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436231552 00000100:00100000:2.0:1787856626.049679:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787856626.049687:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000452d25da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:7893:x1874703436231552:12345-0@lo:502: 00000100:00100000:2.0:1787856626.049793:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000452d25da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:7893:x1874703436231552:12345-0@lo:502: Request processed in 108us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.049800:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787856626.049804:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091693c6d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:7893:1874703436231552:0@lo:502: 00000020:01000000:1.0:1787856626.049827:0:7893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856626.049832:0:7893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856626.050034:0:7893:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787856626.050039:0:7893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787856626.050109:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787856626.050131:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787856626.050139:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.050148:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856626.050157:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787856626.050160:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9065e9fd0000 from 1 10000000:01000000:2.0:1787856626.050162:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787856626.050207:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.050390:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.050400:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.050415:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6dfa6e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436231680:0@lo:101: 00000100:00100000:2.0:1787856626.050447:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.050478:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000002025c336 going to sleep for 11 seconds 00000100:00100000:3.0:1787856626.051059:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436231680 00000100:00100000:3.0:1787856626.051066:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436231680 00000100:00100000:3.0:1787856626.051102:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787856626.051108:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bc41dcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436231680:12345-0@lo:101: 00010000:00010000:3.0:1787856626.051128:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856626.051139:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3778 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.051160:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.051169:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.051175:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000718e3a83, rc 0) 00000100:00100000:3.0:1787856626.051253:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bc41dcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436231680:12345-0@lo:101: Request processed in 145us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856626.051260:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787856626.051459:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6dfa6e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436231680:0@lo:101: 00010000:00010000:2.0:1787856626.051471:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.051478:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.051534:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6dfa6e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436231808:0@lo:501: 00000100:00100000:2.0:1787856626.051560:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.051593:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000002025c336 going to sleep for 11 seconds 00000100:00100000:3.0:1787856626.051710:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436231808 00000100:00100000:3.0:1787856626.051714:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436231808 00000100:00100000:3.0:1787856626.051745:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787856626.051750:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a408aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436231808:12345-0@lo:501: 00000100:00100000:3.0:1787856626.051830:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a408aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436231808:12345-0@lo:501: Request processed in 80us (270us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787856626.051837:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787856626.052051:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6dfa6e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436231808:0@lo:501: 10000000:01000000:1.0:1787856626.052079:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787856626.052084:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856626.052092:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787856626.066419:0:6501:0:(import.c:65:import_set_state_nolock()) 000000000578892c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856626.066574:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d59811ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1874703436230912:12345-0@lo:38: Request processed in 18244us (18564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.066587:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787856626.066619:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856626.066629:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a04e6a32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436231168:12345-0@lo:400: 00000100:00100000:0.0:1787856626.066752:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a04e6a32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436231168:12345-0@lo:400: Request processed in 125us (18592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.066759:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856626.066819:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ca5d23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436231168:0@lo:400: 00000100:00100000:2.0:1787856626.070397:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787856626.070418:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787856626.070428:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787856626.070436:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787856626.070440:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000d3ac27a9 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787856626.070514:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ef5540b0): req@000000008a4fddfa x1874703436231424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856626.070552:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436230912:0@lo:38: 00000100:00100000:1.0:1787856626.070776:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856626.070872:0:7899:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef5540b0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856626.074422:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436231936:0@lo:41: 00000100:00100000:0.0:1787856626.074501:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856626.074566:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436231424 00000100:00100000:0.0:1787856626.074579:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436231424 00000100:00100000:0.0:1787856626.074615:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436231936 00000100:00100000:0.0:1787856626.074618:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436231936 00000100:00100000:0.0:1787856626.074632:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787856626.074639:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091693c6d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7899:x1874703436231424:12345-0@lo:1000: 00000100:00100000:0.0:1787856626.075436:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091693c6d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7899:x1874703436231424:12345-0@lo:1000: Request processed in 796us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.075445:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787856626.075467:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856626.075473:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b2b76cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436231936:12345-0@lo:41: 00000004:00000024:0.0:1787856626.075494:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787856626.075532:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b2b76cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436231936:12345-0@lo:41: Request processed in 60us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.075537:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856626.075577:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436231936:0@lo:41: 00000100:00100000:2.0:1787856626.075741:0:7899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436231424:0@lo:1000: 00000040:01000000:2.0:1787856626.075779:0:7899:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787856626.075815:0:7899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436232064:0@lo:1000: 00000100:00100000:2.0:1787856626.075853:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.075889:0:7899:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064135f99 going to sleep for 11 seconds 00000100:00100000:0.0:1787856626.076357:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436232064 00000100:00100000:0.0:1787856626.076364:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436232064 00000100:00100000:0.0:1787856626.076399:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787856626.076406:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6dfa6e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7899:x1874703436232064:12345-0@lo:1000: 00000100:00100000:0.0:1787856626.076512:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6dfa6e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7899:x1874703436232064:12345-0@lo:1000: Request processed in 107us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.076520:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787856626.076737:0:7899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436232064:0@lo:1000: 00000100:00100000:2.0:1787856626.076785:0:7899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436232192:0@lo:700: 00000100:00100000:2.0:1787856626.076814:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.076843:0:7899:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef5540b0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856626.076997:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436232192 00000100:00100000:0.0:1787856626.077002:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436232192 00000100:00100000:0.0:1787856626.077039:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856626.077045:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062d853fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7899:x1874703436232192:12345-0@lo:700: 00000100:00100000:0.0:1787856626.077095:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062d853fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7899:x1874703436232192:12345-0@lo:700: Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.077108:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787856626.077192:0:7899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a4fddfa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436232192:0@lo:700: 00000100:00100000:2.0:1787856626.077365:0:7899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0da6c92 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436232320:0@lo:1000: 00000100:00100000:2.0:1787856626.077477:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.077497:0:7899:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd8dd889 going to sleep for 11 seconds 00000100:00100000:0.0:1787856626.077815:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436232320 00000100:00100000:0.0:1787856626.077821:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436232320 00000100:00100000:0.0:1787856626.077993:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787856626.078004:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a4fddfa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7899:x1874703436232320:12345-0@lo:1000: 00000100:00100000:0.0:1787856626.078070:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a4fddfa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7899:x1874703436232320:12345-0@lo:1000: Request processed in 68us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.078077:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00000080:3.0:1787856626.081398:0:7902:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe3f87540 20000000:00000080:3.0:1787856626.081416:0:7902:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff906600689000 uarg=0000000000000000 20000000:01000000:3.0:1787856626.081466:0:7902:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787856626.081474:0:7902:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787856626.081478:0:7902:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787856626.081553:0:7902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787856626.081564:0:7902:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000100:00100000:1.0:1787856626.082736:0:7899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0da6c92 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436232320:0@lo:1000: 00000004:00080000:1.0:1787856626.082817:0:7899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ef5540b0 with version 0 00000020:00100000:1.0:1787856626.082844:0:7899:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787856626.082852:0:7899:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b93e52db x1874703436232576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856626.082874:0:7899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b93e52db pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436232576:0@lo:1000: 00000100:00100000:1.0:1787856626.082955:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856626.087821:0:7899:0:(client.c:2715:ptlrpc_set_wait()) set 00000000799b472e going to sleep for 11 seconds 00000040:00080000:3.0:1787856626.089111:0:7902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787856626.089300:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436232576 00000100:00100000:2.0:1787856626.089312:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436232576 00000100:00100000:2.0:1787856626.089376:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856626.089385:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6404085 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7899:x1874703436232576:12345-0@lo:1000: 00000040:00080000:3.0:1787856626.090699:0:7902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787856626.090742:0:7902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787856626.090774:0:7902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787856626.090796:0:7902:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787856626.090815:0:7902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.090831:0:7902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.090848:0:7902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.090854:0:7902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.091074:0:7902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.091090:0:7902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 17 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856626.091105:0:7902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009ffc302e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7902:1874703436232704:0@lo:104: 00000100:00100000:3.0:1787856626.091173:0:7902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.091625:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787856626.091639:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436232704 00000100:00100000:3.0:1787856626.091645:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436232704 00000100:00100000:3.0:1787856626.091700:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856626.091707:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a98f47c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:7902:x1874703436232704:12345-0@lo:104: 00010000:00010000:3.0:1787856626.091719:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.091775:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787856626.091781:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a98f47c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:7902:x1874703436232704:12345-0@lo:104: Request processed in 75us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856626.091788:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787856626.091856:0:7902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.091865:0:7902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 17 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856626.091875:0:7902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7334f90 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7902:1874703436232832:0@lo:104: 00000100:00100000:3.0:1787856626.092152:0:7902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856626.092628:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436232832 00000100:00100000:3.0:1787856626.092633:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436232832 00000100:00100000:3.0:1787856626.092672:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856626.092680:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000618b1e8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:7902:x1874703436232832:12345-0@lo:104: 00010000:00010000:3.0:1787856626.092690:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.092727:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787856626.092731:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000618b1e8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:7902:x1874703436232832:12345-0@lo:104: Request processed in 53us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856626.092737:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787856626.092737:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787856626.092743:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.092750:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856626.092751:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dea317fe already unused, calling callback (00000000f3ade360) 10000000:00010000:2.0:1787856626.092754:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.092769:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856626.092776:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856626.092782:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787856626.092822:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.092829:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856626.092847:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.092853:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 00000000dea317fe/0xc25410d92a3c36ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c36f3 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.092867:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856626.092869:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856626.092870:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856626.092888:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068feb586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436232960:0@lo:103: 00000100:00100000:2.0:1787856626.092919:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.092947:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436232960 00000100:00100000:2.0:1787856626.092951:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436232960 00010000:00010000:2.0:1787856626.092968:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 18 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.092988:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787856626.092994:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048621fd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+18:3624:x1874703436232960:12345-0@lo:103: 00010000:00010000:2.0:1787856626.093011:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856626.093016:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 18 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.093025:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 18 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.093040:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856626.093067:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048621fd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+18:3624:x1874703436232960:12345-0@lo:103: Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.093073:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856626.093325:0:7902:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f3a1bfd going to sleep for 11 seconds 00010000:00010000:3.0:1787856626.093350:0:7902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000246d2fbd/0xc25410d92a3c36f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c36ec expref: 17 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856626.093370:0:7902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009ffc302e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7902:1874703436232704:0@lo:104: 00000100:00100000:2.0:1787856626.093400:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068feb586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436232960:0@lo:103: 00000100:00100000:3.0:1787856626.093451:0:7902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7334f90 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7902:1874703436232832:0@lo:104: 00010000:00010000:3.0:1787856626.093466:0:7902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856626.094060:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1787856626.094068:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787856626.094164:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6404085 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7899:x1874703436232576:12345-0@lo:1000: Request processed in 4779us (11208us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787856626.094174:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1787856626.094213:0:7899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787856626.094233:0:7899:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787856626.094249:0:7899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b93e52db pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436232576:0@lo:1000: 00000100:00100000:2.0:1787856626.094342:0:7899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068feb586 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436233088:0@lo:1000: 00000100:00100000:2.0:1787856626.094378:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.094406:0:7899:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064135f99 going to sleep for 11 seconds 00000100:00100000:0.0:1787856626.094469:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436233088 00000100:00100000:0.0:1787856626.094475:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436233088 00000100:00100000:0.0:1787856626.094512:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787856626.094518:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a1667d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7899:x1874703436233088:12345-0@lo:1000: 00000100:00100000:0.0:1787856626.094581:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a1667d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7899:x1874703436233088:12345-0@lo:1000: Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856626.094587:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787856626.094773:0:7899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068feb586 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7899:1874703436233088:0@lo:1000: 00000040:00080000:2.0:1787856626.094790:0:7899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787856626.094817:0:7899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ef5540b0 with version 1 00000004:00080000:0.0:1787856626.095088:0:7894:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000058b8af09 version 1 rpc_version 1 00000020:00100000:0.0:1787856626.095105:0:7894:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787856626.095112:0:7894:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a13bf411 x1874703436233344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787856626.095126:0:7894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7894:1874703436233344:0@lo:1000: 00000100:00100000:0.0:1787856626.095161:0:7894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856626.095188:0:7894:0:(client.c:2715:ptlrpc_set_wait()) set 000000009000cf13 going to sleep for 11 seconds 00000100:00100000:0.0:1787856626.095200:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436233344 00000100:00100000:0.0:1787856626.095203:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436233344 00000100:00100000:0.0:1787856626.095245:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787856626.095251:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0184ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7894:x1874703436233344:12345-0@lo:1000: 00010000:00010000:0.0:1787856626.095719:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856626.095730:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856626.095732:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856626.095755:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.095765:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bbff083d already unused, calling callback (00000000f3ade360) 10000000:00010000:3.0:1787856626.095770:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.095777:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856626.095784:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856626.095789:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787856626.096105:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.096113:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856626.096136:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.096143:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 00000000bbff083d/0xc25410d92a3c35fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3605 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.096173:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856626.096186:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856626.096188:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856626.096201:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7334f90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436233472:0@lo:103: 00000100:00100000:3.0:1787856626.096394:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1787856626.098744:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1787856626.098902:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0184ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7894:x1874703436233344:12345-0@lo:1000: Request processed in 3649us (3738us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787856626.098914:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1787856626.098962:0:7894:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787856626.098968:0:7894:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787856626.098985:0:7894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a13bf411 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7894:1874703436233344:0@lo:1000: 00000040:00080000:2.0:1787856626.099614:0:7899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787856626.100432:0:7899:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787856626.100439:0:7899:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1787856626.100483:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436233472 00000100:00100000:2.0:1787856626.100491:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436233472 00010000:00010000:2.0:1787856626.100523:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 17 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.100570:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856626.100579:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ffc302e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+17:3625:x1874703436233472:12345-0@lo:103: 00010000:00010000:2.0:1787856626.100593:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856626.100597:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 17 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100609:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 17 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100626:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f5c753ea/0xc25410d92a3c3605 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c35fe expref: 17 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100640:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100647:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100673:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100681:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100687:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100703:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100708:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d1d95cc already unused, calling callback (00000000c3795dd1) 00010000:00010000:2.0:1787856626.100711:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100718:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100739:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856626.100750:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856626.100772:0:7902:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.100779:0:7902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856626.100784:0:7902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005d1d95cc/0xc25410d92a3c3786 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856626.100866:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ffc302e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3625:x1874703436233472:12345-0@lo:103: Request processed in 289us (4473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.100874:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787856626.101471:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7334f90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436233472:0@lo:103: 00000100:00100000:0.0:1787856626.513950:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd5eb143 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436233600:0@lo:41: 00000100:00100000:0.0:1787856626.514045:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856626.514234:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436233600 00000100:00100000:2.0:1787856626.514243:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436233600 00000100:00100000:2.0:1787856626.514304:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787856626.514312:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a13bf411 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436233600:12345-0@lo:41: 00000004:00000024:2.0:1787856626.514347:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00010000:00010000:3.0:1787856626.517430:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856626.518787:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a13bf411 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436233600:12345-0@lo:41: Request processed in 4467us (4733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856626.518804:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787856626.523452:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd5eb143 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436233600:0@lo:41: 00010000:00010000:0.0:1787856627.537491:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856628.563383:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856629.586348:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856630.609913:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856631.121508:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ae37dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436233856:0@lo:400: 00000100:00100000:0.0:1787856631.121703:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d84fa968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436233728:0@lo:400: 00000100:00100000:0.0:1787856631.121749:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856631.121798:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3f2a5fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436234240:0@lo:400: 00000100:00100000:0.0:1787856631.121932:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856631.121973:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075336335 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436234112:0@lo:400: 00000100:00100000:0.0:1787856631.121999:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856631.122035:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856631.122041:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080b0f780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436233984:0@lo:400: 00000100:00100000:0.0:1787856631.122064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856631.122092:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436233728 00000100:00100000:0.0:1787856631.122099:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436233728 00000100:00100000:0.0:1787856631.122138:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787856631.122146:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063db4e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3623:x1874703436233728:12345-0@lo:400: 00000100:00100000:0.0:1787856631.122206:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063db4e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3623:x1874703436233728:12345-0@lo:400: Request processed in 60us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856631.122213:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787856631.122283:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436234240 00000100:00100000:0.0:1787856631.122286:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436234240 00000100:00100000:0.0:1787856631.122301:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436233984 00000100:00100000:0.0:1787856631.122304:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436233984 00000100:00100000:0.0:1787856631.122314:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787856631.122319:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064a15ec5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436234240:12345-0@lo:400: 00000100:00100000:0.0:1787856631.122355:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064a15ec5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436234240:12345-0@lo:400: Request processed in 35us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856631.122360:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787856631.122371:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856631.122376:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6cf2422 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436233984:12345-0@lo:400: 00000100:00100000:0.0:1787856631.122402:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6cf2422 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436233984:12345-0@lo:400: Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856631.122408:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856631.122423:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436234112 00000100:00100000:0.0:1787856631.122426:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436234112 00000100:00100000:0.0:1787856631.122450:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787856631.122455:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff7c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436234112:12345-0@lo:400: 00000100:00100000:0.0:1787856631.122480:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff7c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436234112:12345-0@lo:400: Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856631.122486:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787856631.122542:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080b0f780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436233984:0@lo:400: 00010000:00080000:0.0:1787856631.122554:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000075336335 x1874703436234112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856631.122575:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075336335 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436234112:0@lo:400: 00000100:00100000:1.0:1787856631.122707:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856631.122732:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436234368:0@lo:41: 00000100:00100000:1.0:1787856631.122755:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856631.122790:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d84fa968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436233728:0@lo:400: 00000100:00100000:0.0:1787856631.122800:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3f2a5fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436234240:0@lo:400: 00000100:00100000:3.0:1787856631.122891:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436233856 00000100:00100000:3.0:1787856631.122897:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436233856 00000100:00100000:0.0:1787856631.129314:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436234368 00000100:00100000:0.0:1787856631.129329:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436234368 00000100:00100000:0.0:1787856631.129428:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787856631.129437:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073a7cf5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436234368:12345-0@lo:41: 00000004:00000024:0.0:1787856631.129476:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787856631.129563:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073a7cf5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436234368:12345-0@lo:41: Request processed in 128us (6807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856631.129570:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787856631.129715:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856631.129726:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b93e52db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436233856:12345-0@lo:400: 00000100:00100000:3.0:1787856631.129765:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b93e52db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436233856:12345-0@lo:400: Request processed in 42us (7058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856631.129771:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787856631.137327:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000445f4d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436234368:0@lo:41: 00010000:00080000:1.0:1787856631.137362:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007ae37dab x1874703436233856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856631.137373:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ae37dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436233856:0@lo:400: 00010000:00010000:3.0:1787856631.633502:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856631.633569:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e7a8f3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436234496:0@lo:41: 00000100:00100000:0.0:1787856631.633664:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856631.633945:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436234496 00000100:00100000:3.0:1787856631.633952:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436234496 00000100:00100000:3.0:1787856631.634016:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787856631.634025:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecbb0500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436234496:12345-0@lo:41: 00000004:00000024:3.0:1787856631.634058:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787856631.634113:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecbb0500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436234496:12345-0@lo:41: Request processed in 89us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856631.634120:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787856631.634202:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e7a8f3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436234496:0@lo:41: 00010000:00010000:3.0:1787856632.661521:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856633.682568:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856634.708401:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787856635.438680:0:8401:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787856635.438685:0:8401:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787856635.438686:0:8401:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787856635.438954:0:8401:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000abd3b42b 00000020:01000004:3.0:1787856635.438973:0:8401:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787856635.438986:0:8401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787856635.438999:0:8401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000005104f2be) 00000020:00000080:3.0:1787856635.439014:0:8401:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787856635.482508:0:8401:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787856635.482568:0:8401:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787856635.497428:0:8401:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787856635.497652:0:8401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787856635.497665:0:8401:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787856635.497677:0:8401:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc25410d92a3c3794 00000020:01000004:2.0:1787856635.497683:0:8401:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787856635.497706:0:8401:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787856635.497710:0:8401:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787856635.497716:0:8401:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787856635.497721:0:8401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787856635.497743:0:8401:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000061cf0c03) 00000020:00000080:2.0:1787856635.497756:0:8401:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787856635.499794:0:8401:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787856635.499962:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787856635.499968:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787856635.505260:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787856635.505276:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787856635.506702:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787856635.506716:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787856635.511723:0:8401:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787856635.511950:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787856635.511956:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787856635.514146:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787856635.514153:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787856635.554401:0:8401:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787856635.554653:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787856635.554660:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787856635.556249:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787856635.556263:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787856635.558021:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787856635.558040:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787856635.562032:0:8401:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787856635.562847:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787856635.562858:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787856635.568085:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787856635.568098:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787856635.627913:0:8401:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787856635.629027:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787856635.629040:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787856635.630150:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787856635.630164:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787856635.630679:0:8401:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787856635.630709:0:8401:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787856635.630715:0:8401:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787856635.665213:0:8401:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787856635.665346:0:8401:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787856635.665351:0:8401:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787856635.665353:0:8401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787856635.665354:0:8401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856635.665355:0:8401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856635.665356:0:8401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856635.665357:0:8401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856635.665359:0:8401:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787856635.665360:0:8401:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856635.665361:0:8401:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856635.665363:0:8401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856635.665364:0:8401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787856635.665367:0:8401:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787856635.665369:0:8401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787856635.665370:0:8401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787856635.665371:0:8401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856635.665372:0:8401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856635.665373:0:8401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856635.665374:0:8401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856635.665375:0:8401:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787856635.665376:0:8401:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856635.665377:0:8401:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856635.665378:0:8401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856635.665379:0:8401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787856635.665404:0:8401:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787856635.665421:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b0862a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436234624:0@lo:253: 00000100:00100000:2.0:1787856635.665497:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.665616:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019a63050 going to sleep for 11 seconds 00000100:00100000:0.0:1787856635.665885:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436234624 00000100:00100000:0.0:1787856635.665894:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436234624 00000100:00100000:0.0:1787856635.665986:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787856635.665994:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa389612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:8401:x1874703436234624:12345-0@lo:253: 20000000:01000000:0.0:1787856635.666035:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787856635.666040:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787856635.666045:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787856635.666048:0:6488:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787856635.666273:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787856635.666424:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787856635.666438:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787856635.666455:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787856635.666461:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787856635.666473:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787856635.666489:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787856635.666941:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787856635.666960:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:0.0:1787856635.666962:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:0.0:1787856635.666977:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787856635.666984:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787856635.666996:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787856635.667001:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:0.0:1787856635.667014:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787856635.667020:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787856635.667032:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787856635.667046:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787856635.667116:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1787856635.667127:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:0.0:1787856635.667128:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:0.0:1787856635.667143:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1787856635.667148:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787856635.667161:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1787856635.667166:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:0.0:1787856635.667178:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1787856635.667184:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787856635.667196:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1787856635.667211:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1787856635.667995:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1787856635.668010:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:0.0:1787856635.668012:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:0.0:1787856635.668034:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1787856635.668041:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787856635.668054:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1787856635.668058:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:0.0:1787856635.668069:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1787856635.668075:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787856635.668087:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1787856635.668101:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1787856635.668113:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787856635.668115:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787856635.668119:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787856635.668159:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787856635.668162:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787856635.668698:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787856635.669043:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787856635.669065:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787856635.669079:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787856635.669088:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787856635.669090:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787856635.669451:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1787856635.669483:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1787856635.669499:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787856635.669710:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1787856635.669860:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1787856635.669876:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1787856635.669886:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787856635.669887:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787856635.670154:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1787856635.670173:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1787856635.670187:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1787856635.670511:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1787856635.670530:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1787856635.670545:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1787856635.670639:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787856635.670642:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787856635.671108:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1787856635.671132:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1787856635.671146:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787856635.671369:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787856635.671403:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787856635.671419:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1787856635.671435:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787856635.671452:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671475:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671482:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671489:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671495:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c374e expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671501:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671507:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671542:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671632:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 16 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.671645:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002b902e9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436234752:0@lo:104: 00000100:00100000:0.0:1787856635.671710:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856635.671907:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c374e expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.671916:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c374e expref: 16 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.671930:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d9c24c1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436234880:0@lo:104: 00000100:00100000:0.0:1787856635.671951:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856635.672053:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.672061:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 16 pid: 6490 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.672070:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8aae28 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436235008:0@lo:104: 00000100:00100000:0.0:1787856635.672102:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.672162:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436234752 00000100:00100000:3.0:1787856635.672171:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436234752 00000100:00100000:3.0:1787856635.672238:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436234880 00000100:00100000:3.0:1787856635.672242:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436234880 00000100:00100000:3.0:1787856635.672258:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856635.672265:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fa99be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6488:x1874703436234752:12345-0@lo:104: 00010000:00010000:3.0:1787856635.672275:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.672333:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787856635.672338:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fa99be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6488:x1874703436234752:12345-0@lo:104: Request processed in 74us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.672345:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856635.672361:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856635.672367:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000445f4d4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6488:x1874703436234880:12345-0@lo:104: 00010000:00010000:3.0:1787856635.672373:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.672408:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787856635.672412:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000445f4d4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6488:x1874703436234880:12345-0@lo:104: Request processed in 47us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.672418:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787856635.672477:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856635.672483:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672491:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b6d9497 already unused, calling callback (00000000f3ade360) 10000000:00010000:1.0:1787856635.672494:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672501:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856635.672507:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856635.672513:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856635.672549:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672568:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856635.672601:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672607:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 000000001b6d9497/0xc25410d92a3c3778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c377f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672621:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856635.672629:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672635:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068d7498c already unused, calling callback (00000000f3ade360) 10000000:00010000:1.0:1787856635.672637:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672642:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856635.672647:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856635.672651:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856635.672664:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672669:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856635.672682:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672687:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 0000000068d7498c/0xc25410d92a3c374e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3755 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.672695:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.672697:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.672698:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856635.672705:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856635.672716:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436235136:0@lo:103: 00000100:00100000:1.0:1787856635.672758:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.672932:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856635.672947:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ae37dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436235264:0@lo:103: 00000100:00100000:1.0:1787856635.672972:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.673002:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436235136 00000100:00100000:1.0:1787856635.673006:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436235136 00010000:00010000:1.0:1787856635.673025:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 17 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856635.673041:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436235264 00000100:00100000:1.0:1787856635.673044:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436235264 00010000:00010000:1.0:1787856635.673053:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c374e expref: 18 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856635.673065:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787856635.673070:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3f2a5fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+18:3625:x1874703436235136:12345-0@lo:103: 00010000:00010000:1.0:1787856635.673079:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856635.673083:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 18 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.673092:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 18 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.673108:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856635.673134:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3f2a5fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+18:3625:x1874703436235136:12345-0@lo:103: Request processed in 65us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.673141:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787856635.673153:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787856635.673159:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d84fa968 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+17:3624:x1874703436235264:12345-0@lo:103: 00010000:00010000:1.0:1787856635.673166:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856635.673169:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c374e expref: 17 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.673181:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c374e expref: 17 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.673190:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856635.673214:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d84fa968 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+17:3624:x1874703436235264:12345-0@lo:103: Request processed in 56us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.673247:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787856635.673276:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ae37dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436235264:0@lo:103: 00000100:00100000:1.0:1787856635.673299:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436235136:0@lo:103: 00010000:00010000:0.0:1787856635.673511:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787856635.673522:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787856635.673526:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065f7199800 from 1 10000000:01000000:0.0:1787856635.673529:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787856635.673563:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 0000000019eae3d6/0xc25410d92a3c37a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.673583:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 0000000019eae3d6/0xc25410d92a3c37a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.673592:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 0000000019eae3d6/0xc25410d92a3c37a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.673606:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000063717c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436235392:0@lo:101: 00000100:00100000:0.0:1787856635.673642:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.673665:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0811958 going to sleep for 11 seconds 00000100:00100000:0.0:1787856635.673688:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436235392 00000100:00100000:0.0:1787856635.673692:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436235392 00000100:00100000:0.0:1787856635.673731:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787856635.673745:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aec5b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436235392:12345-0@lo:101: 00010000:00010000:0.0:1787856635.673761:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856635.673773:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3cb418a/0xc25410d92a3c37b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c37a9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.674087:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3cb418a/0xc25410d92a3c37b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.674100:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3cb418a/0xc25410d92a3c37b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.674107:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3cb418a, rc 0) 00000100:00100000:0.0:1787856635.674142:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aec5b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436235392:12345-0@lo:101: Request processed in 398us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.674148:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787856635.674187:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000063717c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436235392:0@lo:101: 00010000:00010000:0.0:1787856635.674198:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 0000000019eae3d6/0xc25410d92a3c37a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.674205:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 0000000019eae3d6/0xc25410d92a3c37a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.674290:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000063717c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436235520:0@lo:501: 00000100:00100000:0.0:1787856635.674326:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.674343:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0811958 going to sleep for 11 seconds 00010000:00010000:0.0:1787856635.674365:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.674374:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 17 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.674389:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000084466de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436235648:0@lo:104: 00000100:00100000:0.0:1787856635.674422:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856635.674439:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.674445:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 17 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.674453:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f35a2cd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436235776:0@lo:104: 00000100:00100000:0.0:1787856635.674471:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.674480:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e3b8647 going to sleep for 11 seconds 00010000:00010000:0.0:1787856635.674492:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000718e3a83/0xc25410d92a3c377f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3778 expref: 17 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.674504:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002b902e9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436234752:0@lo:104: 00010000:00010000:0.0:1787856635.674513:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003f320ba2/0xc25410d92a3c3755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c374e expref: 16 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.674521:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d9c24c1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436234880:0@lo:104: 00000100:00100000:3.0:1787856635.674603:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436235520 00000100:00100000:3.0:1787856635.674608:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436235520 00000100:00100000:3.0:1787856635.674640:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787856635.674646:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb06113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436235520:12345-0@lo:501: 00000100:00100000:3.0:1787856635.674762:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb06113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436235520:12345-0@lo:501: Request processed in 116us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.674769:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787856635.675011:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000063717c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436235520:0@lo:501: 00000100:00100000:0.0:1787856635.675039:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000063717c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436235904:0@lo:503: 00000100:00100000:0.0:1787856635.675077:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.675106:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0811958 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.675146:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436235904 00000100:00100000:3.0:1787856635.675155:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436235904 00000100:00100000:3.0:1787856635.675180:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787856635.675187:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a85edf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436235904:12345-0@lo:503: 00000100:00100000:3.0:1787856635.675280:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a85edf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436235904:12345-0@lo:503: Request processed in 94us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.675287:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787856635.675361:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000063717c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436235904:0@lo:503: 00000100:00100000:1.0:1787856635.675460:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436235008 00000100:00100000:1.0:1787856635.675464:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436235008 00000100:00100000:1.0:1787856635.675484:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436235648 00000100:00100000:1.0:1787856635.675486:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436235648 00000100:00100000:1.0:1787856635.675496:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436235776 00000100:00100000:1.0:1787856635.675498:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436235776 00000100:00100000:1.0:1787856635.675507:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787856635.675512:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d9c656 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:6488:x1874703436235008:12345-0@lo:104: 00010000:00010000:1.0:1787856635.675521:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.675570:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787856635.675586:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d9c656 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:6488:x1874703436235008:12345-0@lo:104: Request processed in 75us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.675592:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787856635.675605:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787856635.675610:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8d194bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6488:x1874703436235648:12345-0@lo:104: 00010000:00010000:1.0:1787856635.675616:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.675660:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787856635.675666:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8d194bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6488:x1874703436235648:12345-0@lo:104: Request processed in 57us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.675672:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787856635.675683:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787856635.675687:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000002a64cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6488:x1874703436235776:12345-0@lo:104: 00010000:00010000:1.0:1787856635.675694:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.675905:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787856635.675911:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000002a64cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6488:x1874703436235776:12345-0@lo:104: Request processed in 224us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.675917:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787856635.675936:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787856635.675940:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.675947:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005b899b46 already unused, calling callback (00000000f3ade360) 10000000:00010000:1.0:1787856635.675951:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.675958:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856635.675965:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856635.675970:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856635.675996:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676003:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856635.676017:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676022:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 000000005b899b46/0xc25410d92a3c3732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3739 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676033:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856635.676036:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676041:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ea85f8d already unused, calling callback (00000000f3ade360) 10000000:00010000:1.0:1787856635.676042:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676048:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856635.676053:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856635.676058:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856635.676069:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676074:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856635.676085:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676102:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 000000007ea85f8d/0xc25410d92a3c36fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3701 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676111:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856635.676113:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676118:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003777d2a9 already unused, calling callback (00000000f3ade360) 10000000:00010000:1.0:1787856635.676120:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676126:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856635.676131:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856635.676136:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856635.676148:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676153:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856635.676157:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676162:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 000000003777d2a9/0xc25410d92a3c3683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c368a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676174:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.676181:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.676182:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856635.676193:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ae37dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436236160:0@lo:103: 00000100:00100000:1.0:1787856635.676244:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.676274:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856635.676279:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075336335 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436236288:0@lo:103: 00000100:00100000:1.0:1787856635.676300:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.676321:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436236032:0@lo:103: 00000100:00100000:1.0:1787856635.676343:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.676367:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436236160 00000100:00100000:1.0:1787856635.676371:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436236160 00010000:00010000:1.0:1787856635.676387:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 16 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856635.676401:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436236288 00000100:00100000:1.0:1787856635.676404:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436236288 00010000:00010000:1.0:1787856635.676412:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 17 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856635.676422:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436236032 00000100:00100000:1.0:1787856635.676424:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436236032 00010000:00010000:1.0:1787856635.676432:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 18 pid: 6490 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856635.676445:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787856635.676450:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080b0f780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+18:3625:x1874703436236160:12345-0@lo:103: 00010000:00010000:1.0:1787856635.676459:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856635.676463:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 18 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676482:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 18 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676497:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856635.676521:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080b0f780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+18:3625:x1874703436236160:12345-0@lo:103: Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.676527:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787856635.676538:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787856635.676543:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0da6c92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+17:3625:x1874703436236288:12345-0@lo:103: 00010000:00010000:1.0:1787856635.676550:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787856635.676676:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787856635.676684:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787856635.676982:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 17 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.676991:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 17 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677002:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856635.677026:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0da6c92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+17:3625:x1874703436236288:12345-0@lo:103: Request processed in 482us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.677032:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787856635.677045:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787856635.677051:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052e9275f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3624:x1874703436236032:12345-0@lo:103: 00010000:00010000:1.0:1787856635.677059:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856635.677062:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 16 pid: 6490 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677070:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 16 pid: 6490 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677086:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677093:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677104:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677110:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677115:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677121:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677126:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000790d81e4 already unused, calling callback (00000000c3795dd1) 00010000:00010000:1.0:1787856635.677128:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677134:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677141:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.677150:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856635.677184:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052e9275f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3624:x1874703436236032:12345-0@lo:103: Request processed in 134us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.677198:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787856635.677270:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075336335 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436236288:0@lo:103: 00000100:00100000:1.0:1787856635.677278:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ae37dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436236160:0@lo:103: 00010000:00010000:0.0:1787856635.677352:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856635.677364:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856635.677388:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009f54b6e6/0xc25410d92a3c3739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3732 expref: 15 pid: 6490 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.677400:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8aae28 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436235008:0@lo:104: 00010000:00010000:0.0:1787856635.677409:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010e9bf8f/0xc25410d92a3c3701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c36fa expref: 14 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.677415:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000084466de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436235648:0@lo:104: 00010000:00010000:0.0:1787856635.677422:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001ee9b244/0xc25410d92a3c368a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3683 expref: 13 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.677428:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f35a2cd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1874703436235776:0@lo:104: 00010000:00010000:0.0:1787856635.677447:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.677454:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.677459:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.677464:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000790d81e4/0xc25410d92a3c37a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787856635.677476:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787856635.677640:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f35a2cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8424:1874703436236416:0@lo:502: 00000100:00100000:0.0:1787856635.677678:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.677698:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c93f245 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.677959:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cf438ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436236032:0@lo:103: 00000100:00100000:3.0:1787856635.677979:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436236416 00000100:00100000:3.0:1787856635.677982:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436236416 00000100:00100000:3.0:1787856635.678009:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787856635.678016:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaecac2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+13:8424:x1874703436236416:12345-0@lo:502: 00000100:00100000:3.0:1787856635.678113:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaecac2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+13:8424:x1874703436236416:12345-0@lo:502: Request processed in 97us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.678119:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787856635.678717:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f35a2cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8424:1874703436236416:0@lo:502: 00000020:01000000:0.0:1787856635.678747:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856635.678755:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856635.678757:0:8424:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787856635.678765:0:8424:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065f7199800 00000020:00000080:0.0:1787856635.678767:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787856635.678857:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8424:1874703436236544:0@lo:502: 00000100:00100000:0.0:1787856635.678897:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.678929:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.679096:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436236544 00000100:00100000:3.0:1787856635.679101:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436236544 00000100:00100000:3.0:1787856635.679138:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787856635.679145:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+13:8424:x1874703436236544:12345-0@lo:502: 00000100:00100000:3.0:1787856635.679252:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+13:8424:x1874703436236544:12345-0@lo:502: Request processed in 107us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.679259:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787856635.679526:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8424:1874703436236544:0@lo:502: 00000020:01000000:1.0:1787856635.679546:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856635.679551:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856635.679653:0:8424:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787856635.679660:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787856635.679869:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787856635.679887:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787856635.679896:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.679906:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856635.679916:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787856635.679919:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065d3be8000 from 30 10000000:01000000:0.0:1787856635.679921:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787856635.679945:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.679953:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.679962:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.679977:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436236672:0@lo:101: 00000100:00100000:0.0:1787856635.680008:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.680037:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.680326:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436236672 00000100:00100000:3.0:1787856635.680331:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436236672 00000100:00100000:3.0:1787856635.680362:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787856635.680370:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+13:6493:x1874703436236672:12345-0@lo:101: 00010000:00010000:3.0:1787856635.680388:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856635.680400:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c37b7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.680418:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.680427:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.680435:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274a200, rc 0) 00000100:00100000:3.0:1787856635.680468:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436236672:12345-0@lo:101: Request processed in 99us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.680474:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787856635.681118:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436236672:0@lo:101: 00010000:00010000:1.0:1787856635.681132:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.681142:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856635.681197:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436236800:0@lo:501: 00000100:00100000:1.0:1787856635.681258:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.681283:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.681521:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436236800 00000100:00100000:3.0:1787856635.681526:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436236800 00000100:00100000:3.0:1787856635.681596:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787856635.681604:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436236800:12345-0@lo:501: 00000100:00100000:3.0:1787856635.681714:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436236800:12345-0@lo:501: Request processed in 110us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.681731:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787856635.681785:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436236800:0@lo:501: 00000100:00100000:1.0:1787856635.682140:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436236928:0@lo:503: 00000100:00100000:1.0:1787856635.682185:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.682768:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856635.682956:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436236928 00000100:00100000:0.0:1787856635.682962:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436236928 00000100:00100000:0.0:1787856635.682992:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787856635.682999:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436236928:12345-0@lo:503: 00000100:00100000:0.0:1787856635.683130:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436236928:12345-0@lo:503: Request processed in 130us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.683137:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787856635.683212:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+13:8401:x1874703436234624:12345-0@lo:253: Request processed in 17218us (17714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.683239:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787856635.683335:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436234624:0@lo:253: 10000000:01000000:2.0:1787856635.683346:0:8401:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787856635.683349:0:8401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787856635.683359:0:8401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787856635.683360:0:8401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856635.683361:0:8401:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787856635.683362:0:8401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856635.683364:0:8401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856635.683365:0:8401:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787856635.683367:0:8401:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787856635.683369:0:8401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856635.683370:0:8401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787856635.683388:0:8401:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9065fe6d5000 from lustre-OST0000 10000000:01000000:2.0:1787856635.683413:0:8401:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787856635.683416:0:8401:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787856635.683424:0:8401:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9065e9fd0000 local copy 10000000:01000000:2.0:1787856635.683428:0:8401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787856635.683454:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.683463:0:8401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.683471:0:8401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856635.683483:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237056:0@lo:101: 00000100:00100000:2.0:1787856635.683512:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.683533:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856635.683590:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436237056 00000100:00100000:0.0:1787856635.683594:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436237056 00000100:00100000:0.0:1787856635.683655:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787856635.683662:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+13:8401:x1874703436237056:12345-0@lo:101: 00010000:00010000:0.0:1787856635.683672:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856635.683684:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c37cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c37c5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.683702:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c37cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c37c5 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.683712:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c37cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37c5 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.683733:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff000, rc 0) 00000100:00100000:0.0:1787856635.683763:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+14:8401:x1874703436237056:12345-0@lo:101: Request processed in 101us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.683768:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787856635.684093:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237056:0@lo:101: 00010000:00010000:2.0:1787856635.684105:0:8401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684114:0:8401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856635.684200:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237184:0@lo:501: 00000100:00100000:2.0:1787856635.684246:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.684266:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436237184 00000100:00100000:2.0:1787856635.684269:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436237184 00000100:00100000:2.0:1787856635.684287:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787856635.684293:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:8401:x1874703436237184:12345-0@lo:501: 00000100:00100000:2.0:1787856635.684339:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:8401:x1874703436237184:12345-0@lo:501: Request processed in 46us (93us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787856635.684345:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787856635.684374:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856635.684386:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237184:0@lo:501: 10000000:01000000:2.0:1787856635.684396:0:8401:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787856635.684411:0:8401:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787856635.684416:0:8401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684423:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000400000000 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684430:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000400000000 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684448:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787856635.684466:0:8401:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9065fe6d5000 10000000:01000000:2.0:1787856635.684471:0:8401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787856635.684475:0:8401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787856635.684482:0:8401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787856635.684486:0:8401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787856635.684488:0:8401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787856635.684501:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684507:0:8401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684514:0:8401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856635.684525:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237312:0@lo:101: 00000100:00100000:2.0:1787856635.684548:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.684591:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436237312 00000100:00100000:2.0:1787856635.684595:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436237312 00000100:00100000:2.0:1787856635.684612:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787856635.684617:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:8401:x1874703436237312:12345-0@lo:101: 00010000:00010000:2.0:1787856635.684624:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856635.684632:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c37d3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684645:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684653:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684659:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b600, rc 0) 00000100:00100000:2.0:1787856635.684681:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8401:x1874703436237312:12345-0@lo:101: Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856635.684693:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787856635.684715:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856635.684902:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237312:0@lo:101: 00010000:00010000:2.0:1787856635.684916:0:8401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.684924:0:8401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856635.684969:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237440:0@lo:501: 00000100:00100000:2.0:1787856635.684992:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.685012:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436237440 00000100:00100000:2.0:1787856635.685015:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436237440 00000100:00100000:2.0:1787856635.685031:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787856635.685036:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8401:x1874703436237440:12345-0@lo:501: 00000100:00100000:2.0:1787856635.685116:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8401:x1874703436237440:12345-0@lo:501: Request processed in 79us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856635.685122:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787856635.685143:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856635.685154:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237440:0@lo:501: 00000100:00100000:2.0:1787856635.685178:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237568:0@lo:503: 00000100:00100000:2.0:1787856635.685213:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.685251:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436237568 00000100:00100000:2.0:1787856635.685255:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436237568 00000100:00100000:2.0:1787856635.685270:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787856635.685275:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8401:x1874703436237568:12345-0@lo:503: 00000100:00100000:2.0:1787856635.685344:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8401:x1874703436237568:12345-0@lo:503: Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856635.685350:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787856635.685379:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7194e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856635.685391:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237568:0@lo:503: 00000040:00080000:2.0:1787856635.685685:0:8401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856635.685903:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436236928:0@lo:503: 00010000:00010000:1.0:1787856635.685946:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856635.685957:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.685965:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b200 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856635.685969:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.685978:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856635.685985:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856635.685991:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856635.686011:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.686018:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856635.686038:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.686045:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076b200/0xc25410d92a3c37c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c37cc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.686056:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.686057:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.686059:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856635.686116:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237824:0@lo:502: 00000100:00100000:2.0:1787856635.686152:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.686175:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436237824 00000100:00100000:2.0:1787856635.686180:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436237824 00000100:00100000:2.0:1787856635.686199:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787856635.686205:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8401:x1874703436237824:12345-0@lo:502: 00000100:00100000:1.0:1787856635.686273:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436237696:0@lo:103: 00000100:00100000:1.0:1787856635.686302:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.686336:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436237696 00000100:00100000:1.0:1787856635.686339:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436237696 00000100:00100000:1.0:1787856635.686379:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856635.686386:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3623:x1874703436237696:12345-0@lo:103: 00010000:00010000:1.0:1787856635.686396:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856635.686407:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c37cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c37c5 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.686419:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856635.686445:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+15:3623:x1874703436237696:12345-0@lo:103: Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.686451:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856635.686474:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436237696:0@lo:103: 00000100:00100000:2.0:1787856635.686658:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:8401:x1874703436237824:12345-0@lo:502: Request processed in 451us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856635.686664:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787856635.686695:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7194e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856635.686705:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237824:0@lo:502: 00000040:00080000:2.0:1787856635.687082:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787856635.687110:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787856635.687123:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787856635.687136:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787856635.687149:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787856635.687178:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787856635.687200:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237952:0@lo:502: 00000100:00100000:0.0:1787856635.687687:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8426:1874703436238080:0@lo:502: 00000100:00100000:0.0:1787856635.687866:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.687952:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.687997:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856635.688079:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787856635.688140:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436238080 00000100:00100000:1.0:1787856635.688146:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436238080 00000100:00100000:1.0:1787856635.688183:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436237952 00000100:00100000:1.0:1787856635.688186:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436237952 00000100:00100000:1.0:1787856635.688200:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787856635.688207:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8426:x1874703436238080:12345-0@lo:502: 00000100:00100000:3.0:1787856635.688451:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787856635.688462:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:8401:x1874703436237952:12345-0@lo:502: 00000100:00100000:3.0:1787856635.688541:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:8401:x1874703436237952:12345-0@lo:502: Request processed in 82us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.688549:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787856635.688621:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436237952:0@lo:502: 00000040:00080000:3.0:1787856635.688690:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787856635.688701:0:8401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:1.0:1787856635.688936:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:8426:x1874703436238080:12345-0@lo:502: Request processed in 728us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.688943:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787856635.694909:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8426:1874703436238080:0@lo:502: 00000100:00100000:0.0:1787856635.695176:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8426:1874703436238208:0@lo:502: 00000100:00100000:0.0:1787856635.695277:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.695319:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.695485:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436238208 00000100:00100000:3.0:1787856635.695491:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436238208 00000100:00100000:3.0:1787856635.695541:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787856635.695562:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:8426:x1874703436238208:12345-0@lo:502: 00000100:00100000:3.0:1787856635.695687:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:8426:x1874703436238208:12345-0@lo:502: Request processed in 137us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.695695:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787856635.695802:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8426:1874703436238208:0@lo:502: 00000040:00080000:0.0:1787856635.695823:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787856635.695889:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787856635.695906:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787856635.695916:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.695928:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856635.695938:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787856635.695942:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787856635.695945:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787856635.695967:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.695974:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.695982:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.695994:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436238336:0@lo:101: 00000100:00100000:0.0:1787856635.696028:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.696056:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.696378:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436238336 00000100:00100000:3.0:1787856635.696383:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436238336 00000100:00100000:3.0:1787856635.696409:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787856635.696415:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+14:6493:x1874703436238336:12345-0@lo:101: 00010000:00010000:3.0:1787856635.696425:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856635.696437:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c37e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.696457:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.696466:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.696473:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274b800, rc 0) 00000100:00100000:3.0:1787856635.696501:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436238336:12345-0@lo:101: Request processed in 86us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.696507:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787856635.696589:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436238336:0@lo:101: 00010000:00010000:0.0:1787856635.696600:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.696609:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.696656:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436238464:0@lo:501: 00000100:00100000:0.0:1787856635.696681:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.696707:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9900 going to sleep for 11 seconds 00000020:01000000:1.0:1787856635.696966:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787856635.696973:0:8427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787856635.696980:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856635.696982:0:8427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787856635.696988:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787856635.697013:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9064c5d9b3a0) 00000020:00000080:1.0:1787856635.697034:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787856635.697041:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787856635.697115:0:8427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065fe6d5000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787856635.697127:0:8427:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787856635.697133:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc25410d92a3c37f6 00000100:00100000:2.0:1787856635.697866:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436238464 00000100:00100000:2.0:1787856635.697872:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436238464 00000100:00100000:2.0:1787856635.697900:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787856635.697907:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436238464:12345-0@lo:501: 00000100:00100000:2.0:1787856635.698030:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436238464:12345-0@lo:501: Request processed in 122us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856635.698037:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787856635.698211:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436238464:0@lo:501: 00000100:00100000:0.0:1787856635.698274:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436238592:0@lo:503: 00000100:00100000:0.0:1787856635.698317:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.698337:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.698440:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436238592 00000100:00100000:3.0:1787856635.698450:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436238592 00000100:00100000:3.0:1787856635.698470:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787856635.698477:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436238592:12345-0@lo:503: 00000100:00100000:3.0:1787856635.698557:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436238592:12345-0@lo:503: Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.698563:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787856635.700682:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436238592:0@lo:503: 00000100:00100000:2.0:1787856635.701482:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8428:1874703436238720:0@lo:502: 00000100:00100000:2.0:1787856635.701549:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.701611:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856635.701707:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436238720 00000100:00100000:0.0:1787856635.701713:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436238720 00000100:00100000:0.0:1787856635.701762:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787856635.701771:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:8428:x1874703436238720:12345-0@lo:502: 00000100:00100000:0.0:1787856635.701955:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:8428:x1874703436238720:12345-0@lo:502: Request processed in 185us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.701964:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787856635.702150:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8428:1874703436238720:0@lo:502: 00000020:01000000:2.0:1787856635.702175:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787856635.702182:0:8428:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787856635.702188:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856635.702190:0:8428:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787856635.702194:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787856635.702198:0:8428:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:2.0:1787856635.702250:0:8428:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787856635.702254:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856635.702268:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9065fe714d70) 00000020:00000080:2.0:1787856635.702287:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type osp with refcount 2 00000020:00000080:2.0:1787856635.702292:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787856635.702372:0:8428:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787856635.702378:0:8428:0:(osd_handler.c:8928:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787856635.702384:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c3804 00010000:00080000:2.0:1787856635.702418:0:8428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9064c5e78000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1787856635.703102:0:8428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787856635.716016:0:8428:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787856635.716067:0:8428:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787856635.716441:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856635.716643:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856635.716746:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00010000:00010000:1.0:1787856635.717136:0:8427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1787856635.718827:0:8427:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000040:00080000:2.0:1787856635.719906:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787856635.720833:0:8429:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787856635.720839:0:8429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787856635.725293:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787856635.725307:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787856635.725351:0:8428:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787856635.725373:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c380b 00000100:00080000:2.0:1787856635.725384:0:8428:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787856635.725390:0:8428:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9064c5e78000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856635.725427:0:8428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9065fe80fc00 x1874703436238848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787856635.725452:0:8428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787856635.725501:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856635.725505:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856635.725507:0:8428:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787856635.725509:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856635.725513:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856635.725515:0:8428:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787856635.725518:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787856635.725520:0:8428:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787856635.725543:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8428:1874703436238976:0@lo:502: 00000100:00100000:2.0:1787856635.725628:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.725663:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436238976 00000100:00100000:2.0:1787856635.725669:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436238976 00000100:00100000:2.0:1787856635.725707:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787856635.725716:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8428:x1874703436238976:12345-0@lo:502: 00000100:00100000:0.0:1787856635.725895:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436238848:0@lo:8: 00000100:00100000:0.0:1787856635.725930:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.726048:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436238848 00000100:00100000:0.0:1787856635.726052:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436238848 00000100:00100000:0.0:1787856635.726080:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787856635.726086:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874703436238848:12345-0@lo:8: 00010000:02000000:0.0:1787856635.726099:0:8407:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (not set up) 00000100:00100000:2.0:1787856635.726188:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:8428:x1874703436238976:12345-0@lo:502: Request processed in 473us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856635.726196:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787856635.726249:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856635.726270:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8428:1874703436238976:0@lo:502: 00000020:01000000:2.0:1787856635.726294:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856635.726297:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856635.726299:0:8428:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787856635.726303:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000001:00000004:1.0:1787856635.728896:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787856635.729319:0:8427:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787856635.729637:0:8427:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787856635.729783:0:8427:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787856635.730027:0:8427:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000100:00100000:3.0:1787856635.730560:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436239360:0@lo:400: 00000100:00100000:3.0:1787856635.730634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.730676:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856635.730683:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436239232:0@lo:400: 00000100:00100000:3.0:1787856635.730753:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.730784:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436239232 00000100:00100000:3.0:1787856635.730802:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436239232 00000100:00100000:3.0:1787856635.730843:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787856635.730851:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436239232:12345-0@lo:400: 00000100:00100000:3.0:1787856635.730904:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436239232:12345-0@lo:400: Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.730911:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787856635.730949:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436239232:0@lo:400: 00010000:00010000:3.0:1787856635.731000:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856635.731011:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436239104:0@lo:400: 00000100:00100000:3.0:1787856635.731037:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.731054:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787856635.731060:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436239488:0@lo:400: 00000100:00100000:3.0:1787856635.731084:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.731109:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436239360 00000100:00100000:3.0:1787856635.731112:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436239360 00000100:00100000:3.0:1787856635.731149:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436239104 00000100:00100000:3.0:1787856635.731153:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436239104 00000100:00100000:3.0:1787856635.731166:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787856635.731172:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436239360:12345-0@lo:400: 00000100:00100000:3.0:1787856635.731204:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436239360:12345-0@lo:400: Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.731210:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787856635.731241:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787856635.731247:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436239104:12345-0@lo:400: 00000100:00100000:3.0:1787856635.731273:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436239104:12345-0@lo:400: Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.731279:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787856635.731292:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436239488 00000100:00100000:3.0:1787856635.731295:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436239488 00000100:00100000:3.0:1787856635.731312:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787856635.731318:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436239488:12345-0@lo:400: 00000100:00100000:3.0:1787856635.731345:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436239488:12345-0@lo:400: Request processed in 28us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.731351:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787856635.731376:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68f00 x1874703436239360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856635.731387:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436239360:0@lo:400: 00000100:00100000:3.0:1787856635.731409:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436239488:0@lo:400: 00010000:00080000:3.0:1787856635.731418:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68780 x1874703436239104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856635.731426:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436239104:0@lo:400: 00000020:01000000:2.0:1787856635.732305:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787856635.732338:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787856635.732349:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.732361:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856635.732371:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787856635.732373:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065d3be8000 from 1 10000000:01000000:2.0:1787856635.732376:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787856635.732409:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.732416:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.732425:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856635.732442:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436239616:0@lo:101: 00000100:00100000:2.0:1787856635.732493:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.732666:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.740338:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436239616 00000100:00100000:3.0:1787856635.740355:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436239616 00000100:00100000:3.0:1787856635.740422:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787856635.740432:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436239616:12345-0@lo:101: 00010000:00010000:3.0:1787856635.740448:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856635.740465:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3812 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.740493:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.740504:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.740513:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274a600, rc 0) 00000100:00100000:3.0:1787856635.740616:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436239616:12345-0@lo:101: Request processed in 184us (8120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.740624:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787856635.740738:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436239616:0@lo:101: 00010000:00010000:2.0:1787856635.740757:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.740767:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856635.740851:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436239744:0@lo:501: 00000100:00100000:2.0:1787856635.740886:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.740925:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.741081:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436239744 00000100:00100000:3.0:1787856635.741086:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436239744 00000100:00100000:3.0:1787856635.741117:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787856635.741125:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436239744:12345-0@lo:501: 00000100:00100000:3.0:1787856635.741263:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436239744:12345-0@lo:501: Request processed in 139us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.741271:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787856635.741299:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436239744:0@lo:501: 00000100:00100000:3.0:1787856635.741325:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436239872:0@lo:503: 00000100:00100000:3.0:1787856635.741376:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.741394:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.741404:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436239872 00000100:00100000:3.0:1787856635.741407:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436239872 00000100:00100000:3.0:1787856635.741424:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787856635.741430:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436239872:12345-0@lo:503: 00000100:00100000:3.0:1787856635.741498:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436239872:12345-0@lo:503: Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.741505:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787856635.741540:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436239872:0@lo:503: 00000020:00000080:2.0:1787856635.743917:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787856635.743933:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856635.743941:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856635.743943:0:8427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787856635.743947:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856635.743951:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856635.743953:0:8427:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787856635.743956:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787856635.743958:0:8427:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787856635.743983:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856635.743986:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856635.743987:0:8427:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787856635.743990:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000100:00100000:3.0:1787856635.746062:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8432:1874703436240000:0@lo:502: 00000100:00100000:3.0:1787856635.746140:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.746178:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.746201:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436240000 00000100:00100000:3.0:1787856635.746207:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436240000 00000100:00100000:3.0:1787856635.746270:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787856635.746280:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:8432:x1874703436240000:12345-0@lo:502: 00000100:00100000:3.0:1787856635.746395:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:8432:x1874703436240000:12345-0@lo:502: Request processed in 115us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.746402:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787856635.746457:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8432:1874703436240000:0@lo:502: 00000020:01000000:3.0:1787856635.746485:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856635.746493:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856635.746497:0:8432:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787856635.746503:0:8432:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065d3be8000 00000020:00000080:3.0:1787856635.746505:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787856635.746525:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8432:1874703436240128:0@lo:502: 00000100:00100000:3.0:1787856635.746560:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.746594:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.746608:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436240128 00000100:00100000:3.0:1787856635.746612:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436240128 00000100:00100000:3.0:1787856635.746633:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787856635.746639:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:8432:x1874703436240128:12345-0@lo:502: 00000100:00100000:3.0:1787856635.746696:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:8432:x1874703436240128:12345-0@lo:502: Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.746702:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787856635.746727:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8432:1874703436240128:0@lo:502: 00000020:01000000:3.0:1787856635.746738:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856635.746741:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856635.746742:0:8432:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787856635.746745:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787856635.747938:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787856635.747959:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787856635.747967:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.747976:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856635.747982:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787856635.747984:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9065e9fd0000 from 1 10000000:01000000:3.0:1787856635.747986:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787856635.748010:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748018:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748038:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856635.748055:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436240256:0@lo:101: 00000100:00100000:3.0:1787856635.748094:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.748117:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.748129:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436240256 00000100:00100000:3.0:1787856635.748132:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436240256 00000100:00100000:3.0:1787856635.748157:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787856635.748165:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436240256:12345-0@lo:101: 00010000:00010000:3.0:1787856635.748175:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856635.748187:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3820 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748205:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748232:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748240:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274be00, rc 0) 00000100:00100000:3.0:1787856635.748271:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436240256:12345-0@lo:101: Request processed in 106us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.748277:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787856635.748313:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436240256:0@lo:101: 00010000:00010000:3.0:1787856635.748327:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748345:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856635.748392:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436240384:0@lo:501: 00000100:00100000:3.0:1787856635.748415:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.748428:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.748435:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436240384 00000100:00100000:3.0:1787856635.748437:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436240384 00000100:00100000:3.0:1787856635.748450:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787856635.748454:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436240384:12345-0@lo:501: 00000100:00100000:3.0:1787856635.748498:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436240384:12345-0@lo:501: Request processed in 43us (83us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787856635.748502:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787856635.748519:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436240384:0@lo:501: 10000000:01000000:3.0:1787856635.748532:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787856635.748535:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748539:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1787856635.748551:0:8401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787856635.748568:0:8401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787856635.748590:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748608:0:8401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856635.748623:0:8401:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe6d5000 from 1 10000000:01000000:3.0:1787856635.748626:0:8401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787856635.748639:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748644:0:8401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748649:0:8401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856635.748656:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436240512:0@lo:101: 00000100:00100000:3.0:1787856635.748672:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.748686:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436240512 00000100:00100000:3.0:1787856635.748688:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436240512 00000100:00100000:3.0:1787856635.748701:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787856635.748705:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:8401:x1874703436240512:12345-0@lo:101: 00010000:00010000:3.0:1787856635.748709:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856635.748715:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c382e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748723:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c382e expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748729:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c382e expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.748737:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274a400, rc 0) 00000100:00100000:3.0:1787856635.748752:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436240512:12345-0@lo:101: Request processed in 47us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.748756:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787856635.748770:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.748778:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436240512:0@lo:101: 00010000:00010000:3.0:1787856635.748784:0:8401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.752146:0:8401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856635.752487:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436240640:0@lo:501: 00000100:00100000:3.0:1787856635.752555:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.752615:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436240640 00000100:00100000:3.0:1787856635.752622:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436240640 00000100:00100000:3.0:1787856635.752666:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787856635.752676:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436240640:12345-0@lo:501: 00000100:00100000:3.0:1787856635.752815:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436240640:12345-0@lo:501: Request processed in 141us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.752821:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787856635.752855:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.752871:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436240640:0@lo:501: 00000100:00100000:3.0:1787856635.752891:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436240768:0@lo:503: 00000100:00100000:3.0:1787856635.752919:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.752939:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436240768 00000100:00100000:3.0:1787856635.752942:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436240768 00000100:00100000:3.0:1787856635.752956:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787856635.752960:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436240768:12345-0@lo:503: 00000100:00100000:3.0:1787856635.753008:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436240768:12345-0@lo:503: Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.753014:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787856635.753046:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.753057:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436240768:0@lo:503: 00000100:00100000:0.0:1787856635.754133:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874703436238848:12345-0@lo:8: Request processed in 28043us (28198us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787856635.754141:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787856635.755369:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c5e78000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856635.755379:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856635.755383:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436238848:0@lo:8: 00000040:00080000:3.0:1787856635.758988:0:8401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787856635.759090:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436240896:0@lo:502: 00000100:00100000:3.0:1787856635.759178:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.759257:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ea840 going to sleep for 11 seconds 00000100:00100000:1.0:1787856635.759391:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436240896 00000100:00100000:1.0:1787856635.759397:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436240896 00000100:00100000:1.0:1787856635.759443:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787856635.759451:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436240896:12345-0@lo:502: 00000100:00100000:1.0:1787856635.759550:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436240896:12345-0@lo:502: Request processed in 100us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.759568:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787856635.761230:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436240896:0@lo:502: 00000040:00080000:3.0:1787856635.761481:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787856635.761508:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787856635.761536:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241024:0@lo:502: 00000100:00100000:3.0:1787856635.761617:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.761653:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436241024 00000100:00100000:3.0:1787856635.761657:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436241024 00000100:00100000:3.0:1787856635.761697:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787856635.761704:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436241024:12345-0@lo:502: 00000100:00100000:3.0:1787856635.761955:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436241024:12345-0@lo:502: Request processed in 250us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.761962:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787856635.762003:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.762013:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241024:0@lo:502: 00000040:00080000:3.0:1787856635.762047:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787856635.762055:0:8401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787856635.765461:0:8435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856635.765474:0:8435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856635.765476:0:8435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787856635.765483:0:8435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065fe6d5000 00000020:00000080:0.0:1787856635.765486:0:8435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787856635.765497:0:8435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856635.765499:0:8435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856635.765501:0:8435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787856635.765504:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787856635.769723:0:8401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787856635.769773:0:8401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787856635.769812:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.769826:0:8401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856635.770058:0:8401:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787856635.770062:0:8401:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9065fe6d5000 10000000:01000000:2.0:1787856635.770065:0:8401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9065fe6d5000 10000000:01000000:2.0:1787856635.770069:0:8401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787856635.770075:0:8401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065fe6d5000 from 1 10000000:01000000:2.0:1787856635.770090:0:8401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787856635.770127:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.770136:0:8401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.770148:0:8401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856635.770171:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241152:0@lo:101: 00000100:00100000:2.0:1787856635.770282:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.770320:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.770526:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436241152 00000100:00100000:3.0:1787856635.770533:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436241152 00000100:00100000:3.0:1787856635.770629:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787856635.770639:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+18:8401:x1874703436241152:12345-0@lo:101: 00010000:00010000:3.0:1787856635.770651:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856635.770665:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c383c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.770689:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c383c expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.770699:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c383c expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.770708:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274ae00, rc 0) 00000100:00100000:3.0:1787856635.770757:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241152:12345-0@lo:101: Request processed in 119us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.770764:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787856635.770842:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241152:0@lo:101: 00010000:00010000:2.0:1787856635.770858:0:8401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856635.770868:0:8401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856635.770957:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241280:0@lo:501: 00000100:00100000:2.0:1787856635.770982:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856635.780967:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436241280 00000100:00100000:0.0:1787856635.780980:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436241280 00000100:00100000:0.0:1787856635.781043:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787856635.781054:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241280:12345-0@lo:501: 00000100:00100000:0.0:1787856635.781200:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241280:12345-0@lo:501: Request processed in 147us (10216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.781207:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787856635.781385:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856635.781407:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241280:0@lo:501: 00000100:00100000:2.0:1787856635.781451:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241408:0@lo:503: 00000100:00100000:2.0:1787856635.781501:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.781525:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856635.781583:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436241408 00000100:00100000:0.0:1787856635.781587:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436241408 00000100:00100000:0.0:1787856635.781604:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787856635.781610:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241408:12345-0@lo:503: 00000100:00100000:0.0:1787856635.781691:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241408:12345-0@lo:503: Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.781704:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787856635.781773:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241408:0@lo:503: 00000040:00080000:2.0:1787856635.782006:0:8401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787856635.782066:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241536:0@lo:502: 00000100:00100000:2.0:1787856635.782099:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.782121:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856635.782164:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436241536 00000100:00100000:0.0:1787856635.782168:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436241536 00000100:00100000:0.0:1787856635.782184:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787856635.782190:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241536:12345-0@lo:502: 00000100:00100000:0.0:1787856635.782343:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241536:12345-0@lo:502: Request processed in 152us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.782350:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787856635.782475:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241536:0@lo:502: 00000040:00080000:2.0:1787856635.782640:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787856635.782663:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787856635.782676:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787856635.782688:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787856635.782701:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787856635.782713:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787856635.782726:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787856635.782738:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787856635.782750:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787856635.782777:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787856635.782793:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787856635.782806:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787856635.782818:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787856635.782832:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787856635.782845:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787856635.782859:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787856635.782873:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787856635.782888:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787856635.782901:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787856635.782912:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787856635.782926:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787856635.782940:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787856635.782954:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787856635.782967:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787856635.782979:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787856635.783010:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787856635.783026:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787856635.783037:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787856635.783050:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787856635.783064:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787856635.783078:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787856635.783093:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787856635.783107:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787856635.783120:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787856635.783134:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787856635.783147:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787856635.783160:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1787856635.783186:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241664:0@lo:502: 00000100:00100000:2.0:1787856635.783437:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856635.783499:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856635.783606:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436241664 00000100:00100000:0.0:1787856635.783611:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436241664 00000100:00100000:0.0:1787856635.783677:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787856635.783685:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241664:12345-0@lo:502: 00000100:00100000:0.0:1787856635.783771:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436241664:12345-0@lo:502: Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.783777:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787856635.783837:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436241664:0@lo:502: 00000040:00080000:2.0:1787856635.783877:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787856635.783886:0:8401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787856635.784377:0:8436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787856635.784393:0:8436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9064c5d9cd70) 00000020:00000080:1.0:1787856635.784413:0:8436:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1787856635.784488:0:8436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065fe6d5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787856635.784492:0:8436:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065fe6d5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787856635.784495:0:8436:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe6d5000 3 00010000:00080000:1.0:1787856635.784529:0:8436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9064c6898800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1787856635.786067:0:8436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1787856635.786297:0:8436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787856635.786335:0:8436:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787856635.786352:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc25410d92a3c3851 00000100:00080000:1.0:1787856635.786361:0:8436:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856635.786366:0:8436:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9064c6898800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856635.786398:0:8436:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9065cd6df480 x1874703436241792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856635.786433:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065cd6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436241792:0@lo:38: 00000100:00100000:1.0:1787856635.786496:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787856635.786548:0:8436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787856635.790670:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436241792 00000100:00100000:3.0:1787856635.790689:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436241792 00000100:00100000:3.0:1787856635.790739:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856635.790749:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874703436241792:12345-0@lo:38: 00010000:00080000:3.0:1787856635.790777:0:6497:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:3.0:1787856635.790811:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc25410d92a3c3858 00000004:00100000:3.0:1787856635.790830:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787856635.790865:0:6497:0:(import.c:65:import_set_state_nolock()) ffff9065fe841000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856635.790959:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874703436241792:12345-0@lo:38: Request processed in 211us (4461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.790966:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787856635.791015:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065cd6df480 x1874703436241792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856635.791027:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787856635.791035:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787856635.791042:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787856635.791046:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787856635.791048:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787856635.791053:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065cd6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436241792:0@lo:38: 00000020:01000004:1.0:1787856635.792474:0:8436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787856635.792490:0:8436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9064c5d98000) 00000020:00000080:1.0:1787856635.792511:0:8436:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type lwp with refcount 2 00000020:01000004:1.0:1787856635.797643:0:8436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065fe6d5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787856635.797654:0:8436:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065fe6d5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787856635.797658:0:8436:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe6d5000 3 00010000:00080000:1.0:1787856635.797692:0:8436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9064c689f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1787856635.801096:0:8436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-7 is initialized 00000020:00000080:1.0:1787856635.810758:0:8436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787856635.810807:0:8436:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787856635.810821:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc25410d92a3c3866 00000100:00080000:1.0:1787856635.810832:0:8436:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856635.810838:0:8436:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9064c689f000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856635.810872:0:8436:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9065cd6de940 x1874703436241920/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856635.810899:0:8436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787856635.811027:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065cd6de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874703436241920:0@lo:38: 00000100:00100000:3.0:1787856635.811094:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.811154:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436241920 00000100:00100000:3.0:1787856635.811160:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436241920 00000100:00100000:3.0:1787856635.811192:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787856635.811200:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874703436241920:12345-0@lo:38: 00010000:00080000:3.0:1787856635.811261:0:6496:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:3.0:1787856635.811296:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc25410d92a3c386d 00000004:00100000:3.0:1787856635.811320:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787856635.811352:0:6496:0:(import.c:65:import_set_state_nolock()) ffff9065fe846800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856635.811403:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874703436241920:12345-0@lo:38: Request processed in 202us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.811411:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787856635.811449:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065cd6de940 x1874703436241920/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856635.811460:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787856635.811467:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787856635.811474:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787856635.811478:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787856635.811480:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c689f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787856635.811486:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065cd6de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874703436241920:0@lo:38: 00000040:00080000:1.0:1787856635.813241:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787856635.814423:0:8401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787856635.814461:0:8401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787856635.814482:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.814495:0:8401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787856635.814552:0:8401:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787856635.814555:0:8401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787856635.814556:0:8401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856635.814557:0:8401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856635.814559:0:8401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856635.814560:0:8401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856635.814561:0:8401:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787856635.814563:0:8401:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787856635.814564:0:8401:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787856635.814583:0:8401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856635.814585:0:8401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787856635.814588:0:8401:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787856635.814591:0:8401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787856635.814592:0:8401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787856635.814593:0:8401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856635.814594:0:8401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856635.814595:0:8401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856635.814596:0:8401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856635.814597:0:8401:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787856635.814598:0:8401:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787856635.814599:0:8401:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787856635.814600:0:8401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856635.814601:0:8401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787856635.814631:0:8401:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787856635.814648:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436242048:0@lo:253: 00000100:00100000:3.0:1787856635.814717:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.814757:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856635.814781:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436242048 00000100:00100000:3.0:1787856635.814786:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436242048 00000100:00100000:3.0:1787856635.814831:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787856635.814839:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436242048:12345-0@lo:253: 20000000:01000000:3.0:1787856635.814865:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787856635.814880:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787856635.823981:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787856635.824103:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787856635.824419:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787856635.824424:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787856635.824447:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.824474:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274b600/0xc25410d92a3c372b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.824483:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.824491:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.824528:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.824542:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 19 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856635.824558:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065cd6dde00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436242176:0@lo:104: 00000100:00100000:1.0:1787856635.824636:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856635.824683:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274b600/0xc25410d92a3c372b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.824691:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274b600/0xc25410d92a3c372b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 19 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856635.824700:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065cd6dc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436242304:0@lo:104: 00000100:00100000:1.0:1787856635.824717:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb4f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787856635.824746:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787856635.824767:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.824790:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436242176 00000100:00100000:1.0:1787856635.824797:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436242176 00000100:00100000:1.0:1787856635.824840:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436242304 00000100:00100000:1.0:1787856635.824843:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436242304 00000100:00100000:1.0:1787856635.824856:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787856635.824865:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660068b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6512:x1874703436242176:12345-0@lo:104: 00010000:00010000:1.0:1787856635.824878:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065c13c9000/0xc25410d92a3c3740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.824921:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787856635.824926:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660068b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6512:x1874703436242176:12345-0@lo:104: Request processed in 62us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.824932:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787856635.824981:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787856635.824987:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6de940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6512:x1874703436242304:12345-0@lo:104: 00010000:00010000:1.0:1787856635.824994:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c3724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825022:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787856635.825026:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6de940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6512:x1874703436242304:12345-0@lo:104: Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856635.825031:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787856635.825047:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856635.825053:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065c13c9000/0xc25410d92a3c3740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825060:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856635.825064:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065c13c9000/0xc25410d92a3c3740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825072:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065c13c9000/0xc25410d92a3c3740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856635.825084:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065c13c9000/0xc25410d92a3c3740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856635.825089:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856635.825113:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065c13c9000/0xc25410d92a3c3740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825119:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856635.825135:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065c13c9000/0xc25410d92a3c3740 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825142:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065c13c9000/0xc25410d92a3c3740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3747 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825507:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856635.825510:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c3724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825516:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9800 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856635.825519:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c3724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825525:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c3724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856635.825531:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c3724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856635.825536:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856635.825556:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c3724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825562:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787856635.825612:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436242560:0@lo:103: 00000100:00100000:2.0:1787856635.825646:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856635.825672:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436242560 00000100:00100000:3.0:1787856635.825676:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436242560 00010000:00010000:1.0:1787856635.825706:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c3724 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825714:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c3724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c372b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.825726:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.825728:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.825729:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856635.825735:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856635.825751:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065cd6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436242432:0@lo:103: 00000100:00100000:1.0:1787856635.825776:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856635.825831:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065cd6dde00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436242176:0@lo:104: 00000100:00100000:1.0:1787856635.825839:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065cd6dc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436242304:0@lo:104: 00010000:00010000:1.0:1787856635.825858:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.825883:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436242432 00000100:00100000:0.0:1787856635.825887:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436242432 00010000:00010000:0.0:1787856635.825905:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 21 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856635.825936:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787856635.825944:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+21:3624:x1874703436242432:12345-0@lo:103: 00010000:00010000:0.0:1787856635.825955:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856635.825960:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 21 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.825979:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 21 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.825992:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3740 expref: 21 pid: 6491 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.826076:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274b600/0xc25410d92a3c372b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 20 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856635.826107:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856635.826113:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c911024a-9030-4ea8-a782-9255ee9580a7+20:3625:x1874703436242560:12345-0@lo:103: 00010000:00010000:3.0:1787856635.826121:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856635.826124:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274b600/0xc25410d92a3c372b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 20 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856635.826152:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856635.826185:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+20:3624:x1874703436242432:12345-0@lo:103: Request processed in 242us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.826191:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787856635.826409:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:8401:x1874703436242048:12345-0@lo:253: Request processed in 11570us (11690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856635.826417:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787856635.827454:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:8401:1874703436242048:0@lo:253: 10000000:01000000:0.0:1787856635.827469:0:8401:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787856635.827473:0:8401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787856635.827474:0:8401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787856635.827476:0:8401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856635.827477:0:8401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856635.827478:0:8401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856635.827480:0:8401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856635.827481:0:8401:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787856635.827483:0:8401:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787856635.827484:0:8401:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787856635.827486:0:8401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856635.827487:0:8401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787856635.827501:0:8401:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787856635.827657:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065cd6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436242432:0@lo:103: 00010000:00010000:3.0:1787856635.831131:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274b600/0xc25410d92a3c372b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 18 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831161:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274b600/0xc25410d92a3c372b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3724 expref: 18 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831179:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831188:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787856635.831212:0:6482:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006788206s 00010000:00010000:3.0:1787856635.831232:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831248:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831256:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831263:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831269:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37c200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856635.831273:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831280:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831315:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856635.831327:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856635.831410:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c911024a-9030-4ea8-a782-9255ee9580a7+17:3625:x1874703436242560:12345-0@lo:103: Request processed in 5295us (5760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856635.831420:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787856635.831428:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436242560:0@lo:103: 00010000:00010000:1.0:1787856635.831502:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.831511:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856635.831517:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3874 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787856635.834042:0:8401:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787856635.834186:0:8401:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787856635.834615:0:8401:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787856635.834741:0:8401:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787856635.835109:0:8401:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787856635.835411:0:8401:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787856635.837599:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787856635.852187:0:8401:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787856635.852198:0:8401:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787856635.852259:0:8401:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787856635.852304:0:8401:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787856635.852327:0:8401:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787856635.852355:0:8401:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787856635.853174:0:8401:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787856635.853400:0:8401:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1787856636.241794:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856636.241820:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436242688:0@lo:41: 00000100:00100000:3.0:1787856636.241883:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856636.241986:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436242688 00000100:00100000:0.0:1787856636.241994:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436242688 00000100:00100000:0.0:1787856636.242045:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856636.242055:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436242688:12345-0@lo:41: 00000004:00000024:0.0:1787856636.242104:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787856636.242152:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436242688:12345-0@lo:41: Request processed in 99us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856636.242160:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856636.242199:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436242688:0@lo:41: 00010000:00010000:3.0:1787856636.753323:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856636.753700:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436242816:0@lo:41: 00000100:00100000:3.0:1787856636.753763:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856636.753842:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436242816 00000100:00100000:3.0:1787856636.753848:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436242816 00000100:00100000:3.0:1787856636.753883:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787856636.753889:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436242816:12345-0@lo:41: 00000004:00000024:3.0:1787856636.753916:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787856636.753947:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436242816:12345-0@lo:41: Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856636.753952:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787856636.753996:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436242816:0@lo:41: 00000020:00000004:1.0:1787856636.824037:0:8493:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787856636.824442:0:8493:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787856637.781879:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856638.803894:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856639.825572:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787856640.849448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856640.849459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787856640.849463:0:8:0:(import.c:65:import_set_state_nolock()) ffff9064c5e78000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856640.849485:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 169 00000100:00080000:3.0:1787856640.849490:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787856640.849497:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9064c5e78000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856640.849520:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9066007c1680 x1874703436243584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787856640.849600:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436243072:0@lo:400: 00000100:00100000:3.0:1787856640.849666:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856640.849714:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436243712:0@lo:400: 00000100:00100000:3.0:1787856640.849735:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856640.849762:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787856640.849768:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436243200:0@lo:400: 00000100:00100000:3.0:1787856640.849792:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856640.849813:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436243840:0@lo:400: 00000100:00100000:3.0:1787856640.849834:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856640.849856:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436243584:0@lo:8: 00000100:00100000:3.0:1787856640.849887:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856640.849921:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436243072 00000100:00100000:3.0:1787856640.849928:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436243072 00000100:00100000:3.0:1787856640.849964:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436243712 00000100:00100000:3.0:1787856640.849966:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436243712 00000100:00100000:3.0:1787856640.850064:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436243840 00000100:00100000:3.0:1787856640.850068:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436243840 00000100:00100000:3.0:1787856640.850084:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787856640.850092:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436243072:12345-0@lo:400: 00000100:00100000:3.0:1787856640.850141:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436243072:12345-0@lo:400: Request processed in 49us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856640.850148:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787856640.850172:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856640.850177:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436243712:12345-0@lo:400: 00000100:00100000:3.0:1787856640.850202:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436243712:12345-0@lo:400: Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856640.850208:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856640.850263:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856640.850270:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436243840:12345-0@lo:400: 00000100:00100000:3.0:1787856640.850297:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436243840:12345-0@lo:400: Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856640.850303:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856640.850321:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436243200 00000100:00100000:3.0:1787856640.850325:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436243200 00000100:00100000:3.0:1787856640.850347:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787856640.850353:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436243200:12345-0@lo:400: 00000100:00100000:3.0:1787856640.850384:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436243200:12345-0@lo:400: Request processed in 31us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856640.850390:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787856640.850475:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436243200:0@lo:400: 00010000:00080000:3.0:1787856640.850487:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c6b5ed00 x1874703436243840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856640.850497:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436243840:0@lo:400: 00010000:00080000:3.0:1787856640.850506:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9066007c0b40 x1874703436243072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856640.850514:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436243072:0@lo:400: 00010000:00080000:3.0:1787856640.850536:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9066007c2d00 x1874703436243712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856640.850552:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436243712:0@lo:400: 00000100:00100000:1.0:1787856640.851092:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436242944:0@lo:400: 00000100:00100000:1.0:1787856640.851134:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856640.851170:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436243456:0@lo:400: 00000100:00100000:1.0:1787856640.851195:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856640.851240:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856640.851248:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436243328:0@lo:400: 00000100:00100000:1.0:1787856640.851275:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856640.851313:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436243584 00000100:00100000:1.0:1787856640.851317:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436243584 00000100:00100000:1.0:1787856640.851350:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856640.851355:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874703436243584:12345-0@lo:8: 00010000:00080000:1.0:1787856640.851380:0:8410:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1787856640.851407:0:8410:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c387b 00002000:00100000:1.0:1787856640.851447:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9064c689a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787856640.851451:0:8410:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787856640.851455:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787856640.851515:0:8410:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787856640.851752:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787856640.851777:0:8410:0:(import.c:65:import_set_state_nolock()) ffff9064c6899800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787856640.851825:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874703436243584:12345-0@lo:8: Request processed in 468us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856640.851833:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787856640.851861:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1787856640.851891:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9066007c1680 x1874703436243584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787856655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856640.851900:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787856640.851907:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787856640.851915:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787856640.851921:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787856640.851923:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c5e78000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787856640.851935:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787856640.851939:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436243584:0@lo:8: 00000100:00100000:1.0:1787856640.851965:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436243456 00000100:00100000:2.0:1787856640.852117:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436243328 00000100:00100000:2.0:1787856640.852123:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436243328 00000100:00100000:2.0:1787856640.852156:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856640.852163:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436243328:12345-0@lo:400: 00000100:00100000:2.0:1787856640.852209:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436243328:12345-0@lo:400: Request processed in 46us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856640.852231:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787856640.852261:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856640.852265:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787856640.852321:0:8429:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787856640.852367:0:8429:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 174562149196ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787856640.852373:0:8429:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:2.0:1787856640.852437:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9066007c0780 x1874703436243328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856640.852448:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436243328:0@lo:400: 00000100:00100000:3.0:1787856640.853056:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436242944 00000100:00100000:3.0:1787856640.853062:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436242944 00000100:00100000:3.0:1787856640.853097:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787856640.853104:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:3624:x1874703436242944:12345-0@lo:400: 00000100:00100000:3.0:1787856640.853154:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:3624:x1874703436242944:12345-0@lo:400: Request processed in 51us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856640.853161:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787856640.853200:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436242944:0@lo:400: 00000100:00100000:1.0:1787856640.855103:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436243456 00000100:00100000:1.0:1787856640.855191:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787856640.855201:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436243456:12345-0@lo:400: 00000100:00100000:1.0:1787856640.855327:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436243456:12345-0@lo:400: Request processed in 128us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856640.855334:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787856640.856131:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436243456:0@lo:400: 00000004:00080000:2.0:1787856640.858769:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787856640.858999:0:8430:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787856640.859025:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856640.859037:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8430:1874703436244096:0@lo:7: 00000100:00100000:3.0:1787856640.859057:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436243968:0@lo:13: 00000100:00100000:0.0:1787856640.863920:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856640.864102:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856640.864108:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe8c4180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856640.864204:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436243968 00000100:00100000:3.0:1787856640.864246:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436243968 00000100:00100000:3.0:1787856640.864457:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856640.864471:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436243968:12345-0@lo:13: 00002000:00000024:3.0:1787856640.864682:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1787856640.864755:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436243968:12345-0@lo:13: Request processed in 287us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856640.864764:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787856640.864901:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d692c0 x1874703436243968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856640.864927:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436243968:0@lo:13: 00000100:00080000:1.0:1787856640.868174:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856640.868308:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436244096 00000100:00100000:1.0:1787856640.868319:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436244096 00000100:00100000:1.0:1787856640.868395:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856640.868407:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8430:x1874703436244096:12345-0@lo:7: 00002000:00080000:1.0:1787856640.879604:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787856640.879614:0:8407:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787856640.879773:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8430:x1874703436244096:12345-0@lo:7: Request processed in 11365us (15857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856640.879786:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787856640.880774:0:8430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68000 x1874703436244096/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787856656 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856640.880793:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8430:1874703436244096:0@lo:7: 00000004:00080000:2.0:1787856640.880810:0:8430:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787856640.880905:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8430:1874703436244224:0@lo:5: 00000100:00100000:2.0:1787856640.880953:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856640.881084:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37840 going to sleep for 11 seconds 00000100:00100000:1.0:1787856640.881124:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436244224 00000100:00100000:1.0:1787856640.881131:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436244224 00000100:00100000:1.0:1787856640.881199:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787856640.881209:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8430:x1874703436244224:12345-0@lo:5: 00002000:00080000:1.0:1787856640.881276:0:8409:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787856640.881281:0:8409:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1787856640.886861:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787856640.886891:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787856640.887124:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8430:x1874703436244224:12345-0@lo:5: Request processed in 5907us (6160us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787856640.887142:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787856640.887201:0:8430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065fe80f0c0 x1874703436244224/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856656 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856640.887254:0:8430:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787856640.887265:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8430:1874703436244224:0@lo:5: 00000004:00080000:1.0:1787856640.887286:0:8430:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787856640.887572:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8430:1874703436244352:0@lo:700: 00000100:00100000:2.0:1787856640.887617:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856640.887663:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37180 going to sleep for 11 seconds 00000100:00100000:0.0:1787856640.887735:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436244352 00000100:00100000:0.0:1787856640.887742:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436244352 00000100:00100000:0.0:1787856640.887801:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787856640.887810:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8430:x1874703436244352:12345-0@lo:700: 00000100:00100000:0.0:1787856640.887845:0:8416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8416:1874703436244480:0@lo:700: 00000100:00100000:1.0:1787856640.887940:0:8416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856640.887984:0:8416:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe8c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856640.888033:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436244480 00000100:00100000:2.0:1787856640.888039:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436244480 00000100:00100000:2.0:1787856640.888081:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787856640.888089:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8416:x1874703436244480:12345-0@lo:700: 40000000:02000000:2.0:1787856640.895833:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1787856640.903714:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8416:x1874703436244480:12345-0@lo:700: Request processed in 15616us (15766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856640.903731:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787856640.904082:0:8416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6bc00 x1874703436244480/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787856656 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856640.904098:0:8416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8416:1874703436244480:0@lo:700: 40000000:02000000:0.0:1787856640.904115:0:8416:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1787856640.929375:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8430:x1874703436244352:12345-0@lo:700: Request processed in 41555us (41745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856640.929400:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787856640.929440:0:8430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065fe80ed00 x1874703436244352/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787856656 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856640.929461:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8430:1874703436244352:0@lo:700: 00000004:02000040:3.0:1787856640.941361:0:8430:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000400 00000100:00100000:3.0:1787856640.945579:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8430:1874703436244608:0@lo:5: 00000100:00100000:3.0:1787856640.945650:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856640.945689:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436244608 00000100:00100000:1.0:1787856640.945697:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436244608 00000100:00100000:3.0:1787856640.945704:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787856640.945766:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856640.945776:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8430:x1874703436244608:12345-0@lo:5: 00002000:00080000:1.0:1787856640.959973:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787856640.959997:0:8407:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787856640.961652:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8430:x1874703436244608:12345-0@lo:5: Request processed in 15871us (15995us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787856640.961667:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787856640.963482:0:8430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c6b5d680 x1874703436244608/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856656 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856640.963504:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8430:1874703436244608:0@lo:5: 00000004:00080000:3.0:1787856640.963519:0:8430:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1787856641.361787:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856641.361815:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436244736:0@lo:41: 00000100:00100000:1.0:1787856641.361884:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856641.361954:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436244736 00000100:00100000:1.0:1787856641.361960:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436244736 00000100:00100000:1.0:1787856641.362001:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856641.362009:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436244736:12345-0@lo:41: 00000004:00000024:1.0:1787856641.362043:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787856641.362081:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436244736:12345-0@lo:41: Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856641.362087:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856641.362127:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436244736:0@lo:41: 00000100:00100000:2.0:1787856641.874735:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436244864:0@lo:41: 00000100:00100000:2.0:1787856641.874805:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856641.874920:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436244864 00000100:00100000:3.0:1787856641.874928:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436244864 00000100:00100000:3.0:1787856641.875049:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787856641.875059:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436244864:12345-0@lo:41: 00000004:00000024:3.0:1787856641.875093:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787856641.875139:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436244864:12345-0@lo:41: Request processed in 81us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856641.875146:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787856641.875190:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436244864:0@lo:41: 00010000:00010000:1.0:1787856641.875350:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787856642.691651:0:8782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787856642.901827:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787856643.487010:0:8834:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787856643.487649:0:8834:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787856643.921774:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787856644.190842:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787856644.945478:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787856645.457301:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787856645.457308:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065f7199800 from 30 10000000:01000000:1.0:1787856645.457323:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787856645.457367:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.457378:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.457388:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856645.457410:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436244992:0@lo:101: 00000100:00100000:1.0:1787856645.457502:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856645.457555:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856645.457791:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436244992 00000100:00100000:0.0:1787856645.457799:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436244992 00000100:00100000:0.0:1787856645.457860:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787856645.457870:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436244992:12345-0@lo:101: 00010000:00010000:0.0:1787856645.457884:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856645.457896:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3882 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856645.457927:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856645.457937:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856645.457945:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ffa00, rc 0) 00000100:00100000:0.0:1787856645.457994:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436244992:12345-0@lo:101: Request processed in 126us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856645.458001:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787856645.458155:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436244992:0@lo:101: 00010000:00010000:1.0:1787856645.458171:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.458181:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856645.458334:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245120:0@lo:501: 00000100:00100000:1.0:1787856645.458362:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856645.458393:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856645.458516:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436245120 00000100:00100000:2.0:1787856645.458521:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436245120 00000100:00100000:2.0:1787856645.458556:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787856645.458566:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436245120:12345-0@lo:501: 00000100:00100000:2.0:1787856645.458683:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436245120:12345-0@lo:501: Request processed in 119us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.458690:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787856645.459553:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245120:0@lo:501: 00000100:00100000:1.0:1787856645.459604:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245248:0@lo:503: 00000100:00100000:1.0:1787856645.459652:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856645.459690:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856645.462574:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436245248 00000100:00100000:2.0:1787856645.462587:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436245248 00000100:00100000:2.0:1787856645.462655:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787856645.462666:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436245248:12345-0@lo:503: 00000100:00100000:2.0:1787856645.462825:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436245248:12345-0@lo:503: Request processed in 160us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.462833:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787856645.463305:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245248:0@lo:503: 00000100:00100000:3.0:1787856645.464339:0:8903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8903:1874703436245376:0@lo:502: 00000100:00100000:3.0:1787856645.464402:0:8903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.464448:0:8903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856645.464553:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436245376 00000100:00100000:1.0:1787856645.464559:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436245376 00000100:00100000:1.0:1787856645.464603:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787856645.464611:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:8903:x1874703436245376:12345-0@lo:502: 00000100:00100000:1.0:1787856645.464736:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:8903:x1874703436245376:12345-0@lo:502: Request processed in 125us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856645.464744:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787856645.464824:0:8903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8903:1874703436245376:0@lo:502: 00000100:00100000:2.0:1787856645.464870:0:8903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8903:1874703436245504:0@lo:502: 00000100:00100000:2.0:1787856645.464906:0:8903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856645.464929:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436245504 00000100:00100000:2.0:1787856645.464933:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436245504 00000100:00100000:2.0:1787856645.464953:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787856645.464961:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:8903:x1874703436245504:12345-0@lo:502: 00000100:00100000:2.0:1787856645.465035:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:8903:x1874703436245504:12345-0@lo:502: Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.465042:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787856645.465071:0:8903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856645.465084:0:8903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8903:1874703436245504:0@lo:502: 00000040:00080000:2.0:1787856645.465106:0:8903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787856645.465263:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787856645.465287:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787856645.465297:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.465307:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856645.465424:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787856645.465427:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065f7199800 from 5 10000000:01000000:1.0:1787856645.465430:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787856645.465455:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.465543:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.465566:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856645.465579:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245632:0@lo:101: 00000100:00100000:1.0:1787856645.465609:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856645.465637:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787856645.468554:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436245632 00000100:00100000:2.0:1787856645.468566:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436245632 00000100:00100000:2.0:1787856645.468631:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787856645.468641:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436245632:12345-0@lo:101: 00010000:00010000:2.0:1787856645.468656:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856645.468673:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3890 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856645.468701:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856645.468713:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856645.468722:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076ae00, rc 0) 00000100:00100000:2.0:1787856645.468803:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436245632:12345-0@lo:101: Request processed in 163us (3193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.468811:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787856645.468838:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245632:0@lo:101: 00010000:00010000:1.0:1787856645.468858:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.468868:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856645.468932:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245760:0@lo:256: 00000100:00100000:1.0:1787856645.468969:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856645.469007:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856645.469175:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436245760 00000100:00100000:3.0:1787856645.469180:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436245760 00000100:00100000:3.0:1787856645.469230:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787856645.469239:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436245760:12345-0@lo:256: 20000000:01000000:3.0:1787856645.469254:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787856645.469270:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787856645.469273:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787856645.469361:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436245760:12345-0@lo:256: Request processed in 123us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856645.469368:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787856645.469469:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245760:0@lo:256: 10000000:01000000:1.0:1787856645.469520:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787856645.469527:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.469535:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856645.469543:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787856645.469546:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1787856645.469554:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787856645.469574:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.469581:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856645.469588:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856645.469599:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245888:0@lo:101: 00000100:00100000:1.0:1787856645.469624:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856645.469652:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787856645.471379:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436245888 00000100:00100000:2.0:1787856645.471388:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436245888 00000100:00100000:2.0:1787856645.471441:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787856645.471452:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436245888:12345-0@lo:101: 00010000:00010000:2.0:1787856645.471477:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856645.471504:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c389e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856645.471526:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c389e expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856645.471536:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c389e expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856645.471543:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a400, rc 0) 00000100:00100000:2.0:1787856645.471617:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436245888:12345-0@lo:101: Request processed in 168us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.471624:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787856645.471708:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436245888:0@lo:101: 00010000:00010000:3.0:1787856645.471724:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.471733:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856645.471799:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436246016:0@lo:501: 00000100:00100000:3.0:1787856645.471829:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.471866:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427600 going to sleep for 11 seconds 00000100:00100000:2.0:1787856645.472429:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436246016 00000100:00100000:2.0:1787856645.472436:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436246016 00000100:00100000:2.0:1787856645.472470:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787856645.472487:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436246016:12345-0@lo:501: 00000100:00100000:2.0:1787856645.472605:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436246016:12345-0@lo:501: Request processed in 128us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.472613:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787856645.472671:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436246016:0@lo:501: 00000100:00100000:3.0:1787856645.472701:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436246144:0@lo:503: 00000100:00100000:3.0:1787856645.472741:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.472766:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427600 going to sleep for 11 seconds 00000100:00100000:2.0:1787856645.472806:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436246144 00000100:00100000:2.0:1787856645.472811:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436246144 00000100:00100000:2.0:1787856645.472845:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787856645.472853:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436246144:12345-0@lo:503: 00000100:00100000:2.0:1787856645.472940:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436246144:12345-0@lo:503: Request processed in 88us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.472948:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787856645.472973:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436246144:0@lo:503: 00000100:00100000:3.0:1787856645.473421:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8905:1874703436246272:0@lo:502: 00000100:00100000:3.0:1787856645.473461:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.473496:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856645.473514:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436246272 00000100:00100000:2.0:1787856645.473519:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436246272 00000100:00100000:2.0:1787856645.473552:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787856645.473559:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:8905:x1874703436246272:12345-0@lo:502: 00000100:00100000:2.0:1787856645.473645:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:8905:x1874703436246272:12345-0@lo:502: Request processed in 86us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.473652:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787856645.473711:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8905:1874703436246272:0@lo:502: 00000020:01000000:3.0:1787856645.473733:0:8905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787856645.473740:0:8905:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787856645.473746:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856645.473748:0:8905:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787856645.473753:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787856645.473756:0:8905:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:3.0:1787856645.473780:0:8905:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787856645.473782:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787856645.473804:0:8905:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9065fe898000) 00000020:00000080:3.0:1787856645.473826:0:8905:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787856645.473833:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787856645.473910:0:8905:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787856645.473916:0:8905:0:(osd_handler.c:8928:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787856645.473922:0:8905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c38b3 00010000:00080000:3.0:1787856645.473948:0:8905:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9066018a1800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1787856645.474179:0:8905:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-8 is initialized 00000040:01000000:3.0:1787856645.484601:0:8905:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787856645.484624:0:8905:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787856645.484818:0:8905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856645.485013:0:8905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856645.485100:0:8905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787856645.485201:0:8905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787856645.486790:0:8907:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856645.486796:0:8907:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787856645.487593:0:8905:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787856645.487607:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787856645.487651:0:8905:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787856645.487684:0:8905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c38ba 00000100:00080000:3.0:1787856645.487695:0:8905:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787856645.487700:0:8905:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9066018a1800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856645.487734:0:8905:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c6b5c000 x1874703436246400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856645.487762:0:8905:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787856645.487851:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436246400:0@lo:8: 00000100:00100000:1.0:1787856645.487922:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856645.487981:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436246400 00000100:00100000:1.0:1787856645.487987:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436246400 00000100:00100000:1.0:1787856645.488019:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787856645.488027:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436246400:12345-0@lo:8: 00010000:00080000:1.0:1787856645.488052:0:8409:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1787856645.488079:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c38c1 00002000:00100000:1.0:1787856645.488093:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9064c7047000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787856645.488097:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787856645.488100:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787856645.488176:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787856645.488200:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9064c7041800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787856645.488277:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1874703436246400:12345-0@lo:8: Request processed in 249us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856645.488294:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787856645.488526:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c6b5c000 x1874703436246400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787856655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856645.488536:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787856645.488543:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787856645.488549:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787856645.488553:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787856645.488555:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066018a1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787856645.488567:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787856645.488572:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436246400:0@lo:8: 00000100:00100000:0.0:1787856645.488862:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436246784:0@lo:400: 00000100:00100000:0.0:1787856645.488893:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856645.488920:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436247296:0@lo:400: 00000100:00100000:2.0:1787856645.488924:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436246784 00000100:00100000:2.0:1787856645.488930:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436246784 00000100:00100000:0.0:1787856645.488945:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856645.488964:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787856645.488969:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436247296 00000100:00100000:0.0:1787856645.488971:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436246656:0@lo:400: 00000100:00100000:2.0:1787856645.488974:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436247296 00000100:00100000:0.0:1787856645.488996:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856645.489012:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436247168:0@lo:400: 00000100:00100000:2.0:1787856645.489019:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787856645.489030:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436246784:12345-0@lo:400: 00000100:00100000:0.0:1787856645.489035:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.489300:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436246912:0@lo:400: 00000100:00100000:3.0:1787856645.489328:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.489346:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787856645.489351:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436246528:0@lo:400: 00000100:00100000:3.0:1787856645.489368:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.489376:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436247040:0@lo:400: 00000100:00100000:3.0:1787856645.489392:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.489410:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436246656 00000100:00100000:3.0:1787856645.489414:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436246656 00000100:00100000:3.0:1787856645.489458:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436246912 00000100:00100000:3.0:1787856645.489460:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436246912 00000100:00100000:3.0:1787856645.489472:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787856645.489478:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436246656:12345-0@lo:400: 00000100:00100000:1.0:1787856645.489597:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787856645.489604:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1787856645.489616:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856645.489625:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436247040 00000100:00100000:1.0:1787856645.489627:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436247040 00000100:00100000:1.0:1787856645.489652:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787856645.489658:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436247040:12345-0@lo:400: 00000100:00100000:1.0:1787856645.489692:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436247040:12345-0@lo:400: Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856645.489698:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787856645.489722:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6a1c0 x1874703436247040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856645.489732:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787856645.489741:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436247040:0@lo:400: 00000100:00080000:1.0:1787856645.489751:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856645.489795:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436246784:12345-0@lo:400: Request processed in 766us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.489802:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787856645.489816:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436247168 00000100:00100000:2.0:1787856645.489819:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436247168 00000100:00100000:2.0:1787856645.489842:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436246528 00000100:00100000:2.0:1787856645.489846:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436246528 00000100:00080000:1.0:1787856645.489847:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856645.489863:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787856645.489871:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436247296:12345-0@lo:400: 00000100:00100000:1.0:1787856645.489883:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787856645.489892:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436247168:12345-0@lo:400: 00000100:00100000:3.0:1787856645.490727:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436246656:12345-0@lo:400: Request processed in 1245us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856645.490736:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787856645.490758:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787856645.490766:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436246912:12345-0@lo:400: 00000100:00100000:3.0:1787856645.490808:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436246912:12345-0@lo:400: Request processed in 44us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856645.490814:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787856645.490868:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436246912:0@lo:400: 00000004:00080000:3.0:1787856645.490888:0:8907:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787856645.490948:0:8907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 179200730009ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787856645.490953:0:8907:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:3.0:1787856645.491284:0:8905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856645.491292:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856645.491295:0:8905:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787856645.491298:0:8905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856645.491302:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856645.491303:0:8905:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787856645.491306:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787856645.491308:0:8905:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787856645.491352:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8905:1874703436247424:0@lo:502: 00000100:00100000:3.0:1787856645.491402:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.491431:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436247424 00000100:00100000:3.0:1787856645.491435:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436247424 00000100:00100000:3.0:1787856645.491463:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787856645.491470:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:8905:x1874703436247424:12345-0@lo:502: 00000100:00100000:3.0:1787856645.491573:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:8905:x1874703436247424:12345-0@lo:502: Request processed in 104us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856645.491579:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787856645.491627:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787856645.491639:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:8905:1874703436247424:0@lo:502: 00000020:01000000:3.0:1787856645.491659:0:8905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856645.491663:0:8905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856645.491664:0:8905:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787856645.491668:0:8905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1787856645.491718:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1787856645.491737:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787856645.491751:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.491760:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856645.491770:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787856645.491772:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065d3be8000 from 5 10000000:01000000:3.0:1787856645.491775:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787856645.491798:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.491806:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.491814:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856645.491829:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436247552:0@lo:101: 00000100:00100000:3.0:1787856645.491855:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.491869:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787856645.491882:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436247552 00000100:00100000:3.0:1787856645.491886:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436247552 00000100:00100000:3.0:1787856645.491907:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787856645.491913:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436247552:12345-0@lo:101: 00010000:00010000:3.0:1787856645.491921:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856645.491931:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c38c8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.491949:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.491966:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.491973:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274bc00, rc 0) 00000100:00100000:3.0:1787856645.492001:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436247552:12345-0@lo:101: Request processed in 87us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856645.492008:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787856645.492054:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436247552:0@lo:101: 00010000:00010000:3.0:1787856645.492065:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.492073:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856645.492113:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436247680:0@lo:256: 00000100:00100000:3.0:1787856645.492140:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.492152:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787856645.492165:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436247680 00000100:00100000:3.0:1787856645.492168:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436247680 00000100:00100000:3.0:1787856645.492188:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787856645.492194:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436247680:12345-0@lo:256: 20000000:01000000:3.0:1787856645.492206:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787856645.492239:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787856645.492242:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787856645.492332:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436247680:12345-0@lo:256: Request processed in 138us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856645.492339:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787856645.492372:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436247680:0@lo:256: 10000000:01000000:3.0:1787856645.492423:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787856645.492429:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856645.492435:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856645.493249:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436246656:0@lo:400: 00000100:00100000:2.0:1787856645.494833:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436247296:12345-0@lo:400: Request processed in 4954us (5878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.494846:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787856645.494878:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787856645.494890:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787856645.494901:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436246528:12345-0@lo:400: 00000100:00100000:2.0:1787856645.494980:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436246528:12345-0@lo:400: Request processed in 82us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.494987:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787856645.495830:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6b840 x1874703436246528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856645.495847:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436246528:0@lo:400: 00000004:00080000:2.0:1787856645.496185:0:7428:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787856645.496548:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436247168:12345-0@lo:400: Request processed in 6650us (7508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856645.496559:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787856645.497005:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6b480 x1874703436247168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856645.497018:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436247168:0@lo:400: 00010000:00080000:0.0:1787856645.497031:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68000 x1874703436246784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856645.497053:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436246784:0@lo:400: 00010000:00080000:0.0:1787856645.497067:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68b40 x1874703436247296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856645.497075:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436247296:0@lo:400: 00000100:00100000:0.0:1787856645.497146:0:8908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8908:1874703436247808:0@lo:700: 00000100:00100000:0.0:1787856645.497204:0:8908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856645.497377:0:8908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe8c4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787856645.498325:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436247808 00000100:00100000:1.0:1787856645.498334:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436247808 00000100:00100000:1.0:1787856645.500601:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856645.500617:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8908:x1874703436247808:12345-0@lo:700: 00000100:00080000:0.0:1787856645.501367:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787856645.506337:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787856645.506521:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8908:x1874703436247808:12345-0@lo:700: Request processed in 5905us (9311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.506538:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787856645.506638:0:8908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68b40 x1874703436247808/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787856661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856645.506654:0:8908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8908:1874703436247808:0@lo:700: 00000004:00080000:0.0:1787856645.515776:0:8908:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000401:0x1:0x0] 00000100:00100000:0.0:1787856645.515810:0:8908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8908:1874703436248064:0@lo:7: 00000100:00100000:0.0:1787856645.515879:0:8908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856645.515927:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436248064 00000100:00100000:0.0:1787856645.515934:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436248064 00000100:00100000:0.0:1787856645.515982:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787856645.515991:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8908:x1874703436248064:12345-0@lo:7: 00002000:00080000:0.0:1787856645.519207:0:8410:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787856645.519237:0:8410:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x1:0x0] 00000100:00100000:0.0:1787856645.519313:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8908:x1874703436248064:12345-0@lo:7: Request processed in 3320us (3431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856645.519323:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787856645.519364:0:8908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe8c4900 going to sleep for 11 seconds 00010000:00080000:0.0:1787856645.519395:0:8908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6b480 x1874703436248064/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787856661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856645.519410:0:8908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8908:1874703436248064:0@lo:7: 00000004:00080000:0.0:1787856645.519425:0:8908:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000401:0x1:0x0] 00000100:00100000:0.0:1787856645.519459:0:8908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8908:1874703436248192:0@lo:5: 00000100:00100000:2.0:1787856645.519551:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436247936:0@lo:13: 00000100:00100000:2.0:1787856645.519584:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856645.519629:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436247936 00000100:00100000:2.0:1787856645.519634:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436247936 00000100:00100000:2.0:1787856645.519670:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787856645.519677:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436247936:12345-0@lo:13: 00002000:00000024:2.0:1787856645.519696:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856645.519724:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436247936:12345-0@lo:13: Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856645.519729:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787856645.519754:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68b40 x1874703436247936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856645.519769:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436247936:0@lo:13: 00000100:00100000:0.0:1787856645.520090:0:8908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856645.520138:0:8908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1787856645.520168:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436248192 00000100:00100000:1.0:1787856645.520173:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436248192 00000100:00100000:1.0:1787856645.520242:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787856645.520249:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8908:x1874703436248192:12345-0@lo:5: 00002000:00080000:1.0:1787856645.520266:0:8409:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787856645.520307:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8908:x1874703436248192:12345-0@lo:5: Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856645.520313:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787856645.520365:0:8908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6b480 x1874703436248192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856645.520387:0:8908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8908:1874703436248192:0@lo:5: 00000004:00080000:2.0:1787856645.520396:0:8908:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000401:0x1:0x0] from OST, last_created [0x280000401:0x1:0x0]last_used is [0x280000401:0x1:0x0] 00000100:00100000:2.0:1787856645.520418:0:8908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8908:1874703436248320:0@lo:5: 00000100:00100000:2.0:1787856645.520439:0:8908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856645.520651:0:8908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856645.520686:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436248320 00000100:00100000:0.0:1787856645.520691:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436248320 00000100:00100000:3.0:1787856645.520733:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856645.520742:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8908:x1874703436248320:12345-0@lo:5: 00002000:00080000:3.0:1787856645.520764:0:8407:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787856645.522702:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8908:x1874703436248320:12345-0@lo:5: Request processed in 1956us (2256us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787856645.522712:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787856645.522776:0:8908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065fe80ed00 x1874703436248320/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856645.522792:0:8908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8908:1874703436248320:0@lo:5: 00000004:00080000:2.0:1787856645.522805:0:8908:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:2.0:1787856645.522841:0:8908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8908:1874703436248448:0@lo:900: 00000100:00100000:2.0:1787856645.522875:0:8908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856645.522948:0:8908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856645.522990:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436248448 00000100:00100000:0.0:1787856645.522997:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436248448 00000100:00100000:0.0:1787856645.523068:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856645.523078:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8908:x1874703436248448:12345-0@lo:900: 00000100:00100000:0.0:1787856645.523137:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8908:x1874703436248448:12345-0@lo:900: Request processed in 60us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856645.523142:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787856645.523189:0:8908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065fe80da40 x1874703436248448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787856661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856645.523200:0:8908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8908:1874703436248448:0@lo:900: 00000020:00000004:3.0:1787856645.893999:0:8941:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787856645.894186:0:8941:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787856645.973474:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856645.973526:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856645.973550:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436248576:0@lo:13: 00000100:00100000:2.0:1787856645.973618:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856645.973747:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436248576 00000100:00100000:3.0:1787856645.973757:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436248576 00000100:00100000:3.0:1787856645.973817:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856645.973827:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436248576:12345-0@lo:13: 00002000:00000024:3.0:1787856645.973850:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856645.973901:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436248576:12345-0@lo:13: Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856645.973908:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787856645.973983:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c6b5f480 x1874703436248576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856645.974003:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436248576:0@lo:13: 00000100:00100000:0.0:1787856646.481594:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856646.481622:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436248704:0@lo:41: 00000100:00100000:0.0:1787856646.481705:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856646.481916:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436248704 00000100:00100000:3.0:1787856646.481924:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436248704 00000100:00100000:3.0:1787856646.481983:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787856646.482006:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436248704:12345-0@lo:41: 00000004:00000024:3.0:1787856646.482038:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787856646.482093:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436248704:12345-0@lo:41: Request processed in 88us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856646.482100:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787856646.482193:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436248704:0@lo:41: 00010000:00010000:2.0:1787856646.995089:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856646.995515:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436248832:0@lo:41: 00000100:00100000:2.0:1787856646.995613:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856646.995827:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436248832 00000100:00100000:3.0:1787856646.995835:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436248832 00000100:00100000:3.0:1787856646.995892:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787856646.995901:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436248832:12345-0@lo:41: 00000004:00000024:3.0:1787856646.995932:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787856646.995995:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436248832:12345-0@lo:41: Request processed in 95us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856646.996002:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787856646.996254:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436248832:0@lo:41: 00000020:00000004:3.0:1787856647.197917:0:8989:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787856647.197928:0:8989:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787856648.017808:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856649.041463:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856650.066345:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856650.577637:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436249088:0@lo:400: 00000100:00100000:0.0:1787856650.577785:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.577860:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436249600:0@lo:400: 00000100:00100000:0.0:1787856650.577894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.577931:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436250112:0@lo:400: 00000100:00100000:0.0:1787856650.577959:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.578012:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787856650.578020:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436248960:0@lo:13: 00000100:00100000:0.0:1787856650.578046:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.578066:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436249472:0@lo:400: 00000100:00100000:0.0:1787856650.578093:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.578109:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436249984:0@lo:400: 00000100:00100000:0.0:1787856650.578130:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.578160:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436249344:0@lo:400: 00000100:00100000:0.0:1787856650.578244:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.578266:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436249856:0@lo:400: 00000100:00100000:0.0:1787856650.578290:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.578310:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787856650.578316:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436249216:0@lo:400: 00000100:00100000:0.0:1787856650.578336:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856650.582669:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436248960 00000100:00100000:1.0:1787856650.582691:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436248960 00000100:00100000:1.0:1787856650.582786:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787856650.582798:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1874703436248960:12345-0@lo:13: 00002000:00000024:1.0:1787856650.582891:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856650.583002:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1874703436248960:12345-0@lo:13: Request processed in 207us (4955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856650.583011:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787856650.583050:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436250112 00000100:00100000:1.0:1787856650.583054:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436250112 00000100:00100000:1.0:1787856650.583081:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856650.583089:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1874703436250112:12345-0@lo:400: 00000100:00100000:1.0:1787856650.583125:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1874703436250112:12345-0@lo:400: Request processed in 37us (5165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856650.583131:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856650.583154:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436249600 00000100:00100000:1.0:1787856650.583159:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436249600 00000100:00100000:1.0:1787856650.583177:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436249344 00000100:00100000:1.0:1787856650.583180:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436249344 00000100:00100000:1.0:1787856650.583195:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787856650.583201:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436249600:12345-0@lo:400: 00000100:00100000:1.0:1787856650.583273:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436249600:12345-0@lo:400: Request processed in 72us (5378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856650.583280:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787856650.583292:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787856650.583298:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436249344:12345-0@lo:400: 00000100:00100000:1.0:1787856650.583328:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436249344:12345-0@lo:400: Request processed in 31us (5112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856650.583334:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787856650.583355:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436249088 00000100:00100000:1.0:1787856650.583360:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436249088 00000100:00100000:1.0:1787856650.583396:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787856650.583403:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:3626:x1874703436249088:12345-0@lo:400: 00000100:00100000:1.0:1787856650.583449:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:3626:x1874703436249088:12345-0@lo:400: Request processed in 47us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856650.583456:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1787856650.583730:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787856650.583784:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065fe80d680 x1874703436248960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856650.583811:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436248960:0@lo:13: 00000100:00100000:0.0:1787856650.583826:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436249088:0@lo:400: 00000100:00100000:0.0:1787856650.583839:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436249600:0@lo:400: 00010000:00080000:0.0:1787856650.583850:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065d9de9680 x1874703436250112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856650.583858:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436250112:0@lo:400: 00000100:00100000:0.0:1787856650.583910:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436249728:0@lo:400: 00000100:00100000:0.0:1787856650.583978:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856650.584008:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436249728 00000100:00100000:0.0:1787856650.584012:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436249728 00000100:00100000:0.0:1787856650.584052:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787856650.584059:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436249728:12345-0@lo:400: 00000100:00100000:0.0:1787856650.584093:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436249728:12345-0@lo:400: Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856650.584099:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787856650.584115:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787856650.584133:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d692c0 x1874703436249728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856650.584143:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436249728:0@lo:400: 00000100:00100000:0.0:1787856650.584156:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436249344:0@lo:400: 00000100:00100000:2.0:1787856650.587607:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436249472 00000100:00100000:2.0:1787856650.587625:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436249472 00000100:00100000:2.0:1787856650.587701:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436249984 00000100:00100000:2.0:1787856650.587706:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436249984 00000100:00100000:2.0:1787856650.587749:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436249856 00000100:00100000:2.0:1787856650.587753:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436249856 00000100:00100000:2.0:1787856650.587769:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436249216 00000100:00100000:2.0:1787856650.587772:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436249216 00000100:00100000:2.0:1787856650.587796:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787856650.587807:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436249472:12345-0@lo:400: 00000100:00080000:0.0:1787856650.588096:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856650.588127:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856650.588404:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787856650.588418:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436249984:12345-0@lo:400: 00000100:00100000:3.0:1787856650.588635:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787856650.588857:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787856650.590784:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787856650.590809:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436249856:12345-0@lo:400: 00000100:00100000:1.0:1787856650.594181:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436249984:12345-0@lo:400: Request processed in 5754us (16034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856650.594199:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787856650.594268:0:8909:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787856650.594285:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787856650.594299:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436249216:12345-0@lo:400: 00000100:00100000:1.0:1787856650.594364:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436249216:12345-0@lo:400: Request processed in 71us (16026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856650.594372:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787856650.595283:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065d9deb480 x1874703436249984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856650.595304:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436249984:0@lo:400: 00010000:00080000:0.0:1787856650.595361:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d69a40 x1874703436249216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856650.595371:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436249216:0@lo:400: 00000100:00100000:2.0:1787856650.598515:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436249472:12345-0@lo:400: Request processed in 10693us (20405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856650.598814:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787856650.599097:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436249856:12345-0@lo:400: Request processed in 8296us (20802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856650.599107:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787856650.599504:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6a1c0 x1874703436249856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856650.599523:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436249856:0@lo:400: 00010000:00080000:0.0:1787856650.600182:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68b40 x1874703436249472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856650.600210:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436249472:0@lo:400: 00000100:00100000:2.0:1787856651.089395:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856651.089444:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436250240:0@lo:13: 00000100:00100000:2.0:1787856651.089534:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856651.089616:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436250240 00000100:00100000:2.0:1787856651.089625:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436250240 00000100:00100000:2.0:1787856651.089696:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856651.089707:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436250240:12345-0@lo:13: 00002000:00000024:2.0:1787856651.089739:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856651.089789:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436250240:12345-0@lo:13: Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856651.089807:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787856651.089859:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065fe80d2c0 x1874703436250240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856651.089880:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436250240:0@lo:13: 00010000:00010000:1.0:1787856651.092995:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787856651.103571:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787856651.602860:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436250368:0@lo:41: 00000100:00100000:0.0:1787856651.602959:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856651.603074:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436250368 00000100:00100000:0.0:1787856651.603083:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436250368 00000100:00100000:0.0:1787856651.603143:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787856651.603154:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436250368:12345-0@lo:41: 00000004:00000024:0.0:1787856651.603202:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787856651.603284:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436250368:12345-0@lo:41: Request processed in 130us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856651.603292:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787856651.603349:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436250368:0@lo:41: 00010000:00010000:3.0:1787856652.113689:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856652.115726:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436250496:0@lo:41: 00000100:00100000:0.0:1787856652.115823:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856652.116741:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436250496 00000100:00100000:3.0:1787856652.116754:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436250496 00000100:00100000:3.0:1787856652.116820:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856652.116832:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436250496:12345-0@lo:41: 00000004:00000024:3.0:1787856652.118984:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787856652.119115:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436250496:12345-0@lo:41: Request processed in 2283us (3289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856652.119127:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856652.120841:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436250496:0@lo:41: 00010000:00010000:2.0:1787856653.151117:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856654.177643:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856655.187763:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856655.697762:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436250624:0@lo:400: 00000100:00100000:3.0:1787856655.697990:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.699631:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436251136:0@lo:400: 00000100:00100000:3.0:1787856655.699694:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.699725:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436251648:0@lo:400: 00000100:00100000:3.0:1787856655.699759:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.699794:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787856655.699803:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436251008:0@lo:400: 00000100:00100000:3.0:1787856655.699839:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.699862:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436251520:0@lo:400: 00000100:00100000:3.0:1787856655.699884:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.699919:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436250752:0@lo:400: 00000100:00100000:3.0:1787856655.699962:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.699980:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436251264:0@lo:400: 00000100:00100000:3.0:1787856655.700002:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.700020:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436251776:0@lo:13: 00000100:00100000:3.0:1787856655.700041:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.700061:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787856655.700068:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436250880:0@lo:400: 00000100:00100000:3.0:1787856655.700099:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.700116:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436251392:0@lo:400: 00000100:00100000:3.0:1787856655.700136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856655.700172:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436251008 00000100:00100000:3.0:1787856655.700181:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436251008 00000100:00100000:3.0:1787856655.700250:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436251520 00000100:00100000:3.0:1787856655.700253:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436251520 00000100:00100000:3.0:1787856655.700279:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436250752 00000100:00100000:3.0:1787856655.700282:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436250752 00000100:00100000:3.0:1787856655.700305:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436251392 00000100:00100000:3.0:1787856655.700308:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436251392 00000100:00100000:3.0:1787856655.700325:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787856655.700334:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436251008:12345-0@lo:400: 00000100:00100000:3.0:1787856655.700404:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436251008:12345-0@lo:400: Request processed in 69us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856655.700413:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787856655.700434:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787856655.700440:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436251520:12345-0@lo:400: 00000100:00100000:3.0:1787856655.700474:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436251520:12345-0@lo:400: Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856655.700480:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787856655.700490:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787856655.700496:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436250752:12345-0@lo:400: 00000100:00100000:3.0:1787856655.700527:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436250752:12345-0@lo:400: Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856655.700533:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787856655.700544:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787856655.700556:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436251392:12345-0@lo:400: 00000100:00100000:2.0:1787856655.700582:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436251136 00000100:00100000:2.0:1787856655.700587:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436251136 00000100:00100000:3.0:1787856655.700592:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436251392:12345-0@lo:400: Request processed in 37us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856655.700598:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787856655.700609:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436250880 00000100:00100000:2.0:1787856655.700612:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436250880 00000100:00100000:3.0:1787856655.700620:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436251648 00000100:00100000:3.0:1787856655.700623:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436251648 00000100:00100000:2.0:1787856655.700623:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787856655.700629:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436251136:12345-0@lo:400: 00000100:00100000:3.0:1787856655.700648:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436251264 00000100:00100000:3.0:1787856655.700651:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436251264 00000100:00100000:3.0:1787856655.700666:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856655.700672:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436251648:12345-0@lo:400: 00000100:00100000:2.0:1787856655.700680:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436251136:12345-0@lo:400: Request processed in 52us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856655.700686:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856655.700700:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436251648:12345-0@lo:400: Request processed in 28us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856655.700700:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856655.700706:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856655.700706:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436250880:12345-0@lo:400: 00000100:00100000:3.0:1787856655.700715:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787856655.700720:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436251264:12345-0@lo:400: 00000100:00100000:2.0:1787856655.700730:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436250880:12345-0@lo:400: Request processed in 24us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856655.700736:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856655.700742:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436251264:12345-0@lo:400: Request processed in 22us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856655.700748:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787856655.700766:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436251776 00000100:00100000:3.0:1787856655.700770:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436251776 00000100:00100000:3.0:1787856655.700808:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856655.700815:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436251776:12345-0@lo:13: 00002000:00000024:3.0:1787856655.700842:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856655.700877:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436251776:12345-0@lo:13: Request processed in 62us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856655.700883:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787856655.700912:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856655.700917:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856655.700925:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856655.700963:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436250880:0@lo:400: 00010000:00080000:3.0:1787856655.700978:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9066007c0000 x1874703436251392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856655.701014:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436251392:0@lo:400: 00010000:00080000:3.0:1787856655.701026:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c6b5da40 x1874703436250752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856655.701035:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436250752:0@lo:400: 00010000:00080000:3.0:1787856655.701044:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c6b5d2c0 x1874703436251264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856655.701051:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436251264:0@lo:400: 00010000:00080000:3.0:1787856655.701061:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c70ee940 x1874703436251776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856655.701068:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787856655.701094:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436251776:0@lo:13: 00010000:00080000:3.0:1787856655.701134:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c6b5d680 x1874703436251008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856655.701144:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436251008:0@lo:400: 00010000:00080000:3.0:1787856655.701153:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9066007c03c0 x1874703436251520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856655.701160:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436251520:0@lo:400: 00000100:00100000:3.0:1787856655.701169:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436251136:0@lo:400: 00010000:00080000:3.0:1787856655.701176:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9066007c0780 x1874703436251648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856655.701191:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436251648:0@lo:400: 00000100:00100000:0.0:1787856655.702730:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436250624 00000100:00100000:0.0:1787856655.702745:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436250624 00000100:00100000:0.0:1787856655.704661:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787856655.704679:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:3626:x1874703436250624:12345-0@lo:400: 00000100:00100000:0.0:1787856655.704817:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:3626:x1874703436250624:12345-0@lo:400: Request processed in 142us (6827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856655.705324:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787856655.705563:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436250624:0@lo:400: 00010000:00010000:2.0:1787856656.210470:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856656.216246:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436251904:0@lo:13: 00000100:00100000:3.0:1787856656.216425:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856656.219571:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436251904 00000100:00100000:0.0:1787856656.219592:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436251904 00000100:00100000:0.0:1787856656.219672:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787856656.219684:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436251904:12345-0@lo:13: 00002000:00000024:0.0:1787856656.219727:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856656.221545:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436251904:12345-0@lo:13: Request processed in 1853us (5110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856656.221561:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787856656.222736:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c70ed680 x1874703436251904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856656.222770:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436251904:0@lo:13: 00000100:00100000:1.0:1787856656.721900:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856656.721936:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436252032:0@lo:41: 00000100:00100000:1.0:1787856656.722032:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856656.722242:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436252032 00000100:00100000:0.0:1787856656.722252:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436252032 00000100:00100000:0.0:1787856656.722318:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787856656.722328:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436252032:12345-0@lo:41: 00000004:00000024:0.0:1787856656.722372:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787856656.722443:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436252032:12345-0@lo:41: Request processed in 116us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856656.722450:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787856656.722547:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436252032:0@lo:41: 00000100:00100000:3.0:1787856657.242923:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856657.242950:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436252160:0@lo:41: 00000100:00100000:3.0:1787856657.243019:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856657.243082:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436252160 00000100:00100000:3.0:1787856657.243090:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436252160 00000100:00100000:3.0:1787856657.243134:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787856657.243142:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436252160:12345-0@lo:41: 00000004:00000024:3.0:1787856657.244118:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787856657.244192:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436252160:12345-0@lo:41: Request processed in 1050us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856657.244202:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787856657.244288:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436252160:0@lo:41: 00010000:00010000:1.0:1787856657.255894:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787856658.150885:0:9488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787856658.150891:0:9488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787856658.150892:0:9488:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787856658.151068:0:9488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9065fe85b800 00000020:01000004:1.0:1787856658.151090:0:9488:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787856658.151109:0:9488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787856658.151127:0:9488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9064c5d999d0) 00000020:00000080:1.0:1787856658.151150:0:9488:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787856658.229252:0:9488:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787856658.229321:0:9488:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1787856658.257568:0:9488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787856658.257993:0:9488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787856658.258012:0:9488:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787856658.258030:0:9488:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc25410d92a3c38dd 00000020:01000004:1.0:1787856658.258040:0:9488:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787856658.258079:0:9488:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 00010000:00010000:3.0:1787856658.258138:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787856658.267767:0:9488:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787856658.267783:0:9488:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787856658.267854:0:9488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787856658.267860:0:9488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787856658.305331:0:9488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787856658.305589:0:9488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.106@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787856658.305594:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787856658.305596:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787856658.305598:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856658.305599:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856658.305600:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856658.305602:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856658.305604:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787856658.305606:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787856658.305608:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787856658.305609:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856658.305610:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787856658.305614:0:9488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787856658.305616:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787856658.305618:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787856658.305619:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856658.305620:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856658.305622:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856658.305623:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856658.305624:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787856658.305629:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787856658.305630:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787856658.305631:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856658.305632:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787856658.305660:0:9488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787856658.305680:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436252288:0@lo:253: 00000100:00100000:0.0:1787856658.305767:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.305890:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe8c4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856658.309157:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436252288 00000100:00100000:3.0:1787856658.309172:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436252288 00000100:00100000:1.0:1787856658.309431:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787856658.309458:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:9488:x1874703436252288:12345-0@lo:253: 20000000:01000000:1.0:1787856658.309514:0:6490:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787856658.309521:0:6490:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787856658.309529:0:6490:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787856658.309533:0:6490:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787856658.310008:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856658.310273:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1787856658.310578:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787856658.310605:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1787856658.310612:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787856658.310634:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1787856658.310650:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1787856658.310780:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1787856658.310811:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:1.0:1787856658.310813:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:1.0:1787856658.310831:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1787856658.310838:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787856658.310869:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1787856658.310876:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:1.0:1787856658.310888:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1787856658.310895:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787856658.310907:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1787856658.310923:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1787856658.311003:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1787856658.311015:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:1.0:1787856658.311023:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:1.0:1787856658.311041:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1787856658.311048:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787856658.311060:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1787856658.311065:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:1.0:1787856658.311079:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1787856658.311085:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787856658.311099:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1787856658.311115:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1787856658.311881:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1787856658.311913:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:0.0:1787856658.311916:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:0.0:1787856658.311931:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1787856658.311937:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787856658.311950:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1787856658.311955:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:0.0:1787856658.311967:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1787856658.311973:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787856658.311985:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1787856658.312000:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1787856658.312014:0:6490:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787856658.312017:0:6490:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787856658.312021:0:6490:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787856658.312083:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787856658.312087:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787856658.316506:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787856658.316578:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787856658.316589:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787856658.316869:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787856658.316894:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787856658.316923:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787856658.316936:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787856658.316939:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787856658.317753:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1787856658.317785:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1787856658.317800:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1787856658.317964:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787856658.317985:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787856658.318001:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1787856658.318012:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787856658.318015:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787856658.319779:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1787856658.320515:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1787856658.320565:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1787856658.320582:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1787856658.320600:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787856658.320603:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787856658.321564:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1787856658.321608:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1787856658.321691:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787856658.321927:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787856658.321964:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787856658.321979:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1787856658.321993:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787856658.321996:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787856658.322956:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1787856658.322995:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1787856658.323010:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787856658.323262:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787856658.323499:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787856658.323524:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:0.0:1787856658.323548:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787856658.323573:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323594:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323603:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323610:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323618:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323634:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c383c expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323641:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323669:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c389e expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323678:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323732:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c389e expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.323751:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c389e expref: 21 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.323772:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e2d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436252416:0@lo:104: 00000100:00100000:0.0:1787856658.323989:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856658.324059:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.324068:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 21 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.324077:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e2580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436252544:0@lo:104: 00000100:00100000:0.0:1787856658.324102:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856658.324263:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436252416 00000100:00100000:1.0:1787856658.324271:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436252416 00000100:00100000:1.0:1787856658.324324:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436252544 00000100:00100000:1.0:1787856658.324328:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436252544 00000100:00100000:1.0:1787856658.324343:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787856658.324352:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:6490:x1874703436252416:12345-0@lo:104: 00010000:00010000:1.0:1787856658.324376:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324440:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787856658.324447:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:6490:x1874703436252416:12345-0@lo:104: Request processed in 96us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856658.324455:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787856658.324476:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787856658.324482:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:6490:x1874703436252544:12345-0@lo:104: 00010000:00010000:1.0:1787856658.324491:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324526:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787856658.324541:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:6490:x1874703436252544:12345-0@lo:104: Request processed in 59us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856658.324547:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787856658.324569:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856658.324576:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324583:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37c400 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856658.324587:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324597:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856658.324604:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856658.324610:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856658.324651:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324659:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856658.324681:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324688:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065cd37c400/0xc25410d92a3c389e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c38a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324703:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856658.324706:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324722:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37d000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856658.324726:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324733:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856658.324739:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856658.324744:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856658.324760:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324766:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856658.324772:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324778:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.324789:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856658.324791:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856658.324793:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856658.325013:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436252672:0@lo:103: 00000100:00100000:1.0:1787856658.325057:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856658.325107:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856658.325112:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436252800:0@lo:103: 00000100:00100000:1.0:1787856658.325162:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856658.325425:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436252672 00000100:00100000:2.0:1787856658.325438:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436252672 00010000:00010000:2.0:1787856658.325469:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c389e expref: 22 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856658.325498:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436252800 00000100:00100000:2.0:1787856658.325501:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436252800 00010000:00010000:2.0:1787856658.325513:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 23 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856658.325528:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856658.325534:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436252672:12345-0@lo:103: 00010000:00010000:2.0:1787856658.325546:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856658.325552:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c389e expref: 23 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.325563:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c389e expref: 23 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.325584:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856658.325618:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436252672:12345-0@lo:103: Request processed in 83us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.325637:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856658.325654:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787856658.325660:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+22:3623:x1874703436252800:12345-0@lo:103: 00010000:00010000:2.0:1787856658.325668:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856658.325673:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 22 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.325682:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 22 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.325702:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856658.325726:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+22:3623:x1874703436252800:12345-0@lo:103: Request processed in 66us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.325733:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787856658.326063:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c383c expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.326077:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c383c expref: 21 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.326088:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e2940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436252928:0@lo:104: 00010000:00010000:3.0:1787856658.326241:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856658.326357:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436252800:0@lo:103: 00000100:00100000:1.0:1787856658.326379:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436252672:0@lo:103: 00000100:00100000:0.0:1787856658.326491:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856658.326548:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.326558:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 21 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.326567:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e30c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436253056:0@lo:104: 00000100:00100000:0.0:1787856658.326590:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856658.326707:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436252928 00000100:00100000:3.0:1787856658.326713:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436252928 00000100:00100000:3.0:1787856658.326748:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436253056 00000100:00100000:3.0:1787856658.326751:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436253056 00000100:00100000:3.0:1787856658.326765:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787856658.326773:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6490:x1874703436252928:12345-0@lo:104: 00010000:00010000:3.0:1787856658.326790:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.326838:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787856658.326843:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6490:x1874703436252928:12345-0@lo:104: Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.326849:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787856658.326864:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787856658.326870:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6490:x1874703436253056:12345-0@lo:104: 00010000:00010000:3.0:1787856658.326878:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.326907:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787856658.326911:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6490:x1874703436253056:12345-0@lo:104: Request processed in 43us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.326931:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787856658.326947:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787856658.326953:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.326961:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076be00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856658.326965:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.326973:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856658.326980:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856658.326986:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787856658.327012:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327018:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856658.327036:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327043:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076be00/0xc25410d92a3c383c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3843 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327055:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856658.327058:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327074:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274aa00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856658.327077:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327084:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856658.327091:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856658.327096:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787856658.327111:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327117:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856658.327123:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327142:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3827 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327152:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856658.327154:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856658.327157:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856658.327170:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436253184:0@lo:103: 00000100:00100000:3.0:1787856658.327199:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856658.327254:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856658.327261:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436253312:0@lo:103: 00000100:00100000:3.0:1787856658.327297:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856658.327328:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436253184 00000100:00100000:3.0:1787856658.327332:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436253184 00010000:00010000:3.0:1787856658.327350:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c383c expref: 22 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856658.327378:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436253312 00000100:00100000:3.0:1787856658.327381:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436253312 00010000:00010000:3.0:1787856658.327392:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 23 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856658.327406:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787856658.327411:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+23:3625:x1874703436253184:12345-0@lo:103: 00010000:00010000:3.0:1787856658.327421:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856658.327426:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c383c expref: 23 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327437:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c383c expref: 23 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327454:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856658.327482:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+23:3625:x1874703436253184:12345-0@lo:103: Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.327489:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787856658.327502:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787856658.327508:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+22:3625:x1874703436253312:12345-0@lo:103: 00010000:00010000:3.0:1787856658.327517:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856658.327522:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 22 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327541:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 22 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.327551:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856658.327573:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+22:3625:x1874703436253312:12345-0@lo:103: Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.327579:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787856658.327665:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436253312:0@lo:103: 00000100:00100000:3.0:1787856658.327673:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436253184:0@lo:103: 00010000:00010000:0.0:1787856658.327810:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.327823:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 21 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.327832:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436253440:0@lo:104: 00000100:00100000:0.0:1787856658.327861:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856658.327909:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.327917:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 21 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.327925:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436253568:0@lo:104: 00000100:00100000:0.0:1787856658.327948:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856658.327965:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.327973:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 21 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.327995:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436253696:0@lo:104: 00000100:00100000:0.0:1787856658.328017:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5a80 going to sleep for 11 seconds 00010000:00010000:0.0:1787856658.328031:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076a400/0xc25410d92a3c38a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c389e expref: 21 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.328043:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e2d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436252416:0@lo:104: 00010000:00010000:0.0:1787856658.328055:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3882 expref: 20 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.328066:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e2580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436252544:0@lo:104: 00010000:00010000:0.0:1787856658.328075:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c383c expref: 19 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.328083:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e2940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436252928:0@lo:104: 00010000:00010000:0.0:1787856658.328091:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274be00/0xc25410d92a3c3827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3820 expref: 18 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.328100:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e30c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436253056:0@lo:104: 00000100:00100000:3.0:1787856658.328167:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787856658.328184:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856658.328195:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436253440 00000100:00100000:3.0:1787856658.328199:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436253440 00000100:00100000:3.0:1787856658.328251:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436253568 00000100:00100000:3.0:1787856658.328256:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436253568 00000100:00100000:3.0:1787856658.328266:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436253696 00000100:00100000:3.0:1787856658.328269:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436253696 00000100:00100000:3.0:1787856658.328279:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787856658.328286:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:6490:x1874703436253440:12345-0@lo:104: 00010000:00010000:3.0:1787856658.328298:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.328346:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787856658.328352:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:6490:x1874703436253440:12345-0@lo:104: Request processed in 67us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.328358:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787856658.328383:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787856658.328397:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6a27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6490:x1874703436253568:12345-0@lo:104: 00010000:00010000:3.0:1787856658.328406:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.328453:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787856658.328459:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6a27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6490:x1874703436253568:12345-0@lo:104: Request processed in 63us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.328466:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787856658.328506:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787856658.328512:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6490:x1874703436253696:12345-0@lo:104: 00010000:00010000:3.0:1787856658.328520:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.328546:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787856658.328551:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6490:x1874703436253696:12345-0@lo:104: Request processed in 40us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.328558:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787856658.328573:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787856658.328579:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.328588:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856658.328593:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.328601:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856658.328608:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.328741:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436253440:0@lo:104: 00000100:00100000:0.0:1787856658.328750:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436253568:0@lo:104: 00000100:00100000:0.0:1787856658.328758:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1874703436253696:0@lo:104: 00010000:00010000:0.0:1787856658.328790:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856658.329142:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787856658.329187:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.329195:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787856658.329309:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436253824:0@lo:103: 00000100:00100000:0.0:1787856658.329358:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856658.329512:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436253824 00000100:00100000:1.0:1787856658.329518:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436253824 00010000:00010000:1.0:1787856658.329544:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 18 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.329549:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.329557:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe400/0xc25410d92a3c37e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.329569:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1787856658.329572:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787856658.329574:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856658.329579:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c911024a-9030-4ea8-a782-9255ee9580a7+18:3623:x1874703436253824:12345-0@lo:103: 00010000:00010000:3.0:1787856658.329580:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856658.329583:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.329591:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.329591:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856658.329595:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 18 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856658.329597:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856658.329604:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856658.329607:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 18 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.329619:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.329623:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274b800/0xc25410d92a3c37e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c37e1 expref: 18 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.329635:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856658.329637:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856658.329733:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436253952:0@lo:103: 00000100:00100000:2.0:1787856658.329766:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787856658.332467:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856658.332487:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.332500:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856658.332504:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.332514:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856658.332521:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856658.332527:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787856658.332597:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.332604:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856658.332649:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.332658:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c37b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.332699:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856658.332701:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856658.332703:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856658.334888:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436253952 00000100:00100000:2.0:1787856658.334919:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436253952 00010000:00010000:2.0:1787856658.334978:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 18 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856658.335013:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787856658.335023:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+18:3624:x1874703436253952:12345-0@lo:103: 00010000:00010000:2.0:1787856658.335041:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856658.335047:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 18 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.335063:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 18 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.335086:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076b600/0xc25410d92a3c37da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c37d3 expref: 18 pid: 6488 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.335108:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856658.335214:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+17:3624:x1874703436253952:12345-0@lo:103: Request processed in 191us (5446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.335242:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787856658.335294:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436253952:0@lo:103: 00000100:00100000:1.0:1787856658.340825:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c911024a-9030-4ea8-a782-9255ee9580a7+16:3623:x1874703436253824:12345-0@lo:103: Request processed in 11230us (11450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856658.340845:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787856658.340899:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856658.340922:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436254080:0@lo:103: 00000100:00100000:1.0:1787856658.341001:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856658.341076:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436254080 00000100:00100000:1.0:1787856658.341102:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436254080 00010000:00010000:1.0:1787856658.341148:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 16 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856658.341174:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787856658.341183:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3626:x1874703436254080:12345-0@lo:103: 00010000:00010000:1.0:1787856658.341198:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856658.341203:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 16 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341255:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 16 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341276:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274a200/0xc25410d92a3c37be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c37b7 expref: 16 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341297:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341308:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341338:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341345:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341352:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341370:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341383:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856658.341388:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341398:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341421:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.341432:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856658.341476:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+15:3626:x1874703436254080:12345-0@lo:103: Request processed in 293us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856658.341482:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787856658.341518:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436254080:0@lo:103: 00010000:00010000:1.0:1787856658.341545:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856658.342419:0:6490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.342434:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.342449:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c38e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787856658.342468:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1787856658.343977:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.343996:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076a600/0xc25410d92a3c37d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37da expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.344042:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856658.344045:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856658.344048:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856658.344168:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436253824:0@lo:103: 00000100:00100000:1.0:1787856658.348693:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+14:9488:x1874703436252288:12345-0@lo:253: Request processed in 39170us (42850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856658.348714:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787856658.349190:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436252288:0@lo:253: 10000000:01000000:0.0:1787856658.349213:0:9488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787856658.349277:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787856658.349279:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787856658.349281:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856658.349282:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787856658.349284:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856658.349285:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856658.349287:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787856658.349289:0:9488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787856658.349290:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856658.349292:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787856658.349322:0:9488:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9065fe85b800 from lustre-OST0001 10000000:01000000:0.0:1787856658.349372:0:9488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787856658.349375:0:9488:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787856658.349389:0:9488:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9065e9fd0000 local copy 10000000:01000000:0.0:1787856658.349393:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787856658.349448:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.349461:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.349471:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.349494:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254208:0@lo:101: 00000100:00100000:0.0:1787856658.349548:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.349597:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787856658.349902:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436254208 00000100:00100000:3.0:1787856658.349909:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436254208 00000100:00100000:3.0:1787856658.349965:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787856658.349976:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+14:9488:x1874703436254208:12345-0@lo:101: 00010000:00010000:3.0:1787856658.349993:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856658.350010:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c9800/0xc25410d92a3c38f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c38eb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.350040:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c9800/0xc25410d92a3c38f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c38eb expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.350053:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c9800/0xc25410d92a3c38f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c38eb expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.350065:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9800, rc 0) 00000100:00100000:3.0:1787856658.350117:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254208:12345-0@lo:101: Request processed in 143us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.350124:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787856658.350376:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254208:0@lo:101: 00010000:00010000:0.0:1787856658.350393:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.350403:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.350527:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254336:0@lo:501: 00000100:00100000:0.0:1787856658.350562:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.350599:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856658.350725:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436254336 00000100:00100000:1.0:1787856658.350730:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436254336 00000100:00100000:1.0:1787856658.350769:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787856658.350777:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254336:12345-0@lo:501: 00000100:00100000:1.0:1787856658.350853:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254336:12345-0@lo:501: Request processed in 77us (291us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787856658.350860:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787856658.352274:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254336:0@lo:501: 10000000:01000000:0.0:1787856658.352305:0:9488:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787856658.352356:0:9488:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787856658.352376:0:9488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.352389:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.352397:0:9488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.352429:0:9488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787856658.352470:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9065fe85b800 10000000:01000000:0.0:1787856658.352476:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787856658.352483:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787856658.352486:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787856658.352492:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787856658.352514:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787856658.352549:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.352558:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.352569:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.352589:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254464:0@lo:101: 00010000:00010000:2.0:1787856658.352786:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856658.352795:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.352816:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffa00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856658.352820:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.352829:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856658.352837:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856658.352843:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787856658.352869:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.352875:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856658.352909:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.352917:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffa00/0xc25410d92a3c38eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc25410d92a3c38f2 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.352934:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856658.352936:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856658.352938:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856658.352994:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436254592:0@lo:103: 00000100:00100000:1.0:1787856658.360925:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856658.361243:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436254592 00000100:00100000:2.0:1787856658.361256:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436254592 00000100:00100000:2.0:1787856658.361338:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787856658.361350:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+15:3626:x1874703436254592:12345-0@lo:103: 00010000:00010000:2.0:1787856658.361378:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856658.361423:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c9800/0xc25410d92a3c38f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c38eb expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.361449:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856658.361519:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+14:3626:x1874703436254592:12345-0@lo:103: Request processed in 171us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.361527:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856658.361645:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436254592:0@lo:103: 00000100:00100000:0.0:1787856658.362754:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.362809:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856658.362876:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436254464 00000100:00100000:2.0:1787856658.362884:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436254464 00000100:00100000:2.0:1787856658.362931:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787856658.362940:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+14:9488:x1874703436254464:12345-0@lo:101: 00010000:00010000:2.0:1787856658.362958:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856658.362980:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c38f9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.363011:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.363025:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.363035:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b600, rc 0) 00000100:00100000:2.0:1787856658.363113:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254464:12345-0@lo:101: Request processed in 174us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.363120:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787856658.363312:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254464:0@lo:101: 00010000:00010000:0.0:1787856658.363332:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.363342:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.363495:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254720:0@lo:501: 00000100:00100000:0.0:1787856658.363535:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.363619:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787856658.366843:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436254720 00000100:00100000:3.0:1787856658.366891:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436254720 00000100:00100000:2.0:1787856658.367072:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787856658.367096:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254720:12345-0@lo:501: 00000100:00100000:2.0:1787856658.367369:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254720:12345-0@lo:501: Request processed in 277us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.367388:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787856658.367552:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254720:0@lo:501: 00000100:00100000:0.0:1787856658.367636:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254848:0@lo:503: 00000100:00100000:0.0:1787856658.367701:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.367747:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5000 going to sleep for 11 seconds 00000100:00100000:1.0:1787856658.367884:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436254848 00000100:00100000:1.0:1787856658.367891:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436254848 00000100:00100000:1.0:1787856658.367929:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787856658.367936:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254848:12345-0@lo:503: 00000100:00100000:1.0:1787856658.368039:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254848:12345-0@lo:503: Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856658.368047:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787856658.368273:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254848:0@lo:503: 00000040:00080000:0.0:1787856658.368859:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787856658.368948:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254976:0@lo:502: 00000100:00100000:0.0:1787856658.369003:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.369146:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5000 going to sleep for 11 seconds 00000100:00100000:1.0:1787856658.373537:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436254976 00000100:00100000:1.0:1787856658.373560:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436254976 00000100:00100000:2.0:1787856658.374757:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787856658.374775:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254976:12345-0@lo:502: 00000100:00100000:2.0:1787856658.375025:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436254976:12345-0@lo:502: Request processed in 255us (6022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.375034:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787856658.375268:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436254976:0@lo:502: 00000040:00080000:3.0:1787856658.375659:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787856658.375699:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787856658.375714:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787856658.375727:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787856658.375740:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787856658.375754:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787856658.375801:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255104:0@lo:502: 00000100:00100000:3.0:1787856658.375862:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856658.375919:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001600 going to sleep for 11 seconds 00000100:00100000:1.0:1787856658.376105:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436255104 00000100:00100000:1.0:1787856658.376114:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436255104 00000100:00100000:1.0:1787856658.377456:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787856658.377479:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436255104:12345-0@lo:502: 00000100:00100000:1.0:1787856658.378273:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436255104:12345-0@lo:502: Request processed in 801us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856658.378285:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787856658.378430:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255104:0@lo:502: 00000040:00080000:3.0:1787856658.378536:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787856658.378555:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1787856658.382579:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787856658.382596:0:9500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787856658.382605:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856658.382608:0:9500:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787856658.382615:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787856658.382647:0:9500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9065fe8999d0) 00000020:00000080:3.0:1787856658.382687:0:9500:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787856658.382696:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787856658.382824:0:9500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065fe85b800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787856658.382834:0:9500:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787856658.382842:0:9500:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc25410d92a3c390e 00010000:00010000:2.0:1787856658.390607:0:9500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1787856658.395195:0:9500:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787856658.403832:0:9500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787856658.404321:0:9500:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787856658.409917:0:9500:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787856658.410110:0:9500:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787856658.425385:0:9500:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787856658.426909:0:9500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787856658.426927:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856658.426935:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856658.426938:0:9500:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787856658.426942:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856658.426947:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856658.426949:0:9500:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787856658.426953:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787856658.426955:0:9500:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787856658.426987:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856658.426991:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856658.426992:0:9500:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787856658.426996:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787856658.427481:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787856658.427522:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787856658.427557:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.427572:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856658.427581:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe85b800 from 1 10000000:01000000:0.0:1787856658.427584:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787856658.427644:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.427653:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.427667:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.427700:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255232:0@lo:101: 00000100:00100000:0.0:1787856658.427797:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.427866:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787856658.427984:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436255232 00000100:00100000:3.0:1787856658.427993:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436255232 00000100:00100000:3.0:1787856658.428057:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787856658.428069:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:9488:x1874703436255232:12345-0@lo:101: 00010000:00010000:3.0:1787856658.428085:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856658.428100:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3915 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.428132:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.428145:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.428155:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9000, rc 0) 00000100:00100000:3.0:1787856658.428201:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255232:12345-0@lo:101: Request processed in 134us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.428209:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787856658.432918:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255232:0@lo:101: 00010000:00010000:0.0:1787856658.432960:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.432989:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.433143:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255360:0@lo:501: 00000100:00100000:0.0:1787856658.433251:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.433298:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856658.433327:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436255360 00000100:00100000:0.0:1787856658.433334:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436255360 00000100:00100000:0.0:1787856658.433413:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787856658.433424:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255360:12345-0@lo:501: 00000100:00100000:0.0:1787856658.433553:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255360:12345-0@lo:501: Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.433562:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787856658.433608:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255360:0@lo:501: 00000100:00100000:0.0:1787856658.433779:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255488:0@lo:503: 00000100:00100000:0.0:1787856658.433822:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.433837:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856658.433851:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436255488 00000100:00100000:0.0:1787856658.433854:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436255488 00000100:00100000:0.0:1787856658.433873:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787856658.433878:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255488:12345-0@lo:503: 00000100:00100000:0.0:1787856658.433962:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255488:12345-0@lo:503: Request processed in 83us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.433970:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787856658.434014:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255488:0@lo:503: 00000040:00080000:0.0:1787856658.434337:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787856658.435273:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255616:0@lo:502: 00000100:00100000:0.0:1787856658.435422:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.435471:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856658.435499:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436255616 00000100:00100000:0.0:1787856658.435506:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436255616 00000100:00100000:0.0:1787856658.435551:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787856658.435562:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255616:12345-0@lo:502: 00000100:00100000:0.0:1787856658.435739:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255616:12345-0@lo:502: Request processed in 178us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.435748:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787856658.435804:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255616:0@lo:502: 00000040:00080000:0.0:1787856658.436095:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787856658.436129:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787856658.436154:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255744:0@lo:502: 00000100:00100000:0.0:1787856658.436191:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.436209:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856658.436247:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436255744 00000100:00100000:0.0:1787856658.436252:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436255744 00000100:00100000:0.0:1787856658.436271:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787856658.436278:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255744:12345-0@lo:502: 00000100:00100000:0.0:1787856658.436932:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255744:12345-0@lo:502: Request processed in 650us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.436942:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787856658.437004:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255744:0@lo:502: 00000040:00080000:0.0:1787856658.437061:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787856658.437081:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787856658.438091:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856658.438104:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856658.438108:0:9504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787856658.438116:0:9504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065fe85b800 00000020:00000080:3.0:1787856658.438119:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787856658.438133:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856658.438136:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856658.438138:0:9504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787856658.438141:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787856658.438466:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787856658.438493:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787856658.438520:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.438533:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856658.438586:0:9488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787856658.438590:0:9488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9065fe85b800 10000000:01000000:0.0:1787856658.438594:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9065fe85b800 10000000:01000000:0.0:1787856658.438599:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787856658.438605:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065fe85b800 from 1 10000000:01000000:0.0:1787856658.438608:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787856658.438829:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.438840:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.438852:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.438877:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255872:0@lo:101: 00000100:00100000:0.0:1787856658.438945:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.438994:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787856658.439054:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436255872 00000100:00100000:3.0:1787856658.439062:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436255872 00000100:00100000:3.0:1787856658.439110:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787856658.439120:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:9488:x1874703436255872:12345-0@lo:101: 00010000:00010000:3.0:1787856658.439136:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856658.439151:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3923 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.439180:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.439193:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856658.439204:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8e00, rc 0) 00000100:00100000:3.0:1787856658.439277:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436255872:12345-0@lo:101: Request processed in 158us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.439284:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787856658.440335:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436255872:0@lo:101: 00010000:00010000:0.0:1787856658.440440:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.440467:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.440588:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436256000:0@lo:501: 00000100:00100000:0.0:1787856658.440706:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.440754:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856658.440825:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436256000 00000100:00100000:2.0:1787856658.440832:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436256000 00000100:00100000:2.0:1787856658.440876:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787856658.440885:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436256000:12345-0@lo:501: 00000100:00100000:2.0:1787856658.441036:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436256000:12345-0@lo:501: Request processed in 151us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.441044:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787856658.441124:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436256000:0@lo:501: 00000100:00100000:0.0:1787856658.441156:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436256128:0@lo:503: 00000100:00100000:0.0:1787856658.441193:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.441244:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856658.441723:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436256128 00000100:00100000:2.0:1787856658.441730:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436256128 00000100:00100000:2.0:1787856658.441762:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787856658.441771:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436256128:12345-0@lo:503: 00000100:00100000:2.0:1787856658.441871:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436256128:12345-0@lo:503: Request processed in 102us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.441880:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787856658.442472:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436256128:0@lo:503: 00000040:00080000:0.0:1787856658.443014:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787856658.443114:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436256256:0@lo:502: 00000100:00100000:0.0:1787856658.443175:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.444195:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856658.449854:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436256256 00000100:00100000:2.0:1787856658.449877:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436256256 00000100:00100000:2.0:1787856658.449961:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787856658.449973:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436256256:12345-0@lo:502: 00000100:00100000:2.0:1787856658.450235:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436256256:12345-0@lo:502: Request processed in 245us (7040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.450246:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787856658.452334:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436256256:0@lo:502: 00000040:00080000:1.0:1787856658.452830:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787856658.452877:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787856658.452893:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787856658.452907:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787856658.452922:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787856658.452938:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787856658.452951:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787856658.452964:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787856658.452977:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787856658.452991:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787856658.453005:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787856658.453019:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787856658.453032:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787856658.453045:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787856658.453057:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787856658.453069:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787856658.453082:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787856658.453096:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787856658.453109:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787856658.453121:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787856658.453134:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787856658.453147:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787856658.453159:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787856658.453194:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787856658.453210:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787856658.453255:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787856658.453271:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787856658.453284:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787856658.453297:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787856658.453310:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787856658.453324:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787856658.453337:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787856658.455467:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787856658.455500:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787856658.455538:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787856658.455553:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787856658.455566:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1787856658.455581:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787856658.455596:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1787856658.455789:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1787856658.455808:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1787856658.455824:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1787856658.455837:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1787856658.455851:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1787856658.455865:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1787856658.455879:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1787856658.455947:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436256384:0@lo:502: 00000100:00100000:1.0:1787856658.456057:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856658.456168:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9dcf480 going to sleep for 11 seconds 00000100:00100000:0.0:1787856658.457992:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436256384 00000100:00100000:0.0:1787856658.458010:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436256384 00000100:00100000:0.0:1787856658.458129:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787856658.458142:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436256384:12345-0@lo:502: 00000100:00100000:0.0:1787856658.458698:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436256384:12345-0@lo:502: Request processed in 557us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.458708:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787856658.459396:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436256384:0@lo:502: 00000040:00080000:1.0:1787856658.459512:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1787856658.459530:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1787856658.463680:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787856658.463737:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9064c78619d0) 00000020:00000080:1.0:1787856658.463777:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1787856658.463892:0:9505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065fe85b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787856658.463897:0:9505:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065fe85b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787856658.463900:0:9505:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe85b800 3 00010000:00080000:1.0:1787856658.463940:0:9505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9064c723f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1787856658.465660:0:9505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1787856658.465910:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787856658.465962:0:9505:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787856658.465977:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc25410d92a3c3938 00000100:00080000:1.0:1787856658.465991:0:9505:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856658.466005:0:9505:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9064c723f800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856658.466053:0:9505:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c70ee940 x1874703436256512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856658.466103:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436256512:0@lo:38: 00000100:00100000:1.0:1787856658.466194:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787856658.466296:0:9505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787856658.467641:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436256768:0@lo:400: 00000100:00100000:0.0:1787856658.467707:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.467759:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436257280:0@lo:400: 00000100:00100000:0.0:1787856658.467808:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.467835:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787856658.467841:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436256640:0@lo:400: 00000100:00100000:0.0:1787856658.467864:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.467882:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436257152:0@lo:400: 00000100:00100000:0.0:1787856658.467906:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856658.467941:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436256512 00000100:00100000:0.0:1787856658.467949:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436256512 00000100:00100000:0.0:1787856658.467982:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436257280 00000100:00100000:0.0:1787856658.467985:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436257280 00000100:00100000:0.0:1787856658.468026:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436256640 00000100:00100000:0.0:1787856658.468029:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436256640 00000100:00100000:0.0:1787856658.468047:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787856658.468057:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7926580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436257280:12345-0@lo:400: 00000100:00100000:0.0:1787856658.468113:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7926580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436257280:12345-0@lo:400: Request processed in 57us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.468122:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787856658.468140:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787856658.468146:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436256640:12345-0@lo:400: 00000100:00100000:0.0:1787856658.468174:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436256640:12345-0@lo:400: Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.468180:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787856658.468191:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787856658.468196:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874703436256512:12345-0@lo:38: 00010000:00080000:0.0:1787856658.468253:0:6497:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1787856658.468301:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc25410d92a3c393f 00000004:00100000:0.0:1787856658.468325:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787856658.468390:0:6497:0:(import.c:65:import_set_state_nolock()) ffff9064c688f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856658.468435:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874703436256512:12345-0@lo:38: Request processed in 238us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.468442:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787856658.468492:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c70ee940 x1874703436256512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856658.468504:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787856658.468515:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787856658.468523:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787856658.468528:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787856658.468531:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787856658.468538:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436256512:0@lo:38: 00010000:00080000:0.0:1787856658.468573:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065d9de9680 x1874703436256640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856658.468582:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436256640:0@lo:400: 00010000:00080000:0.0:1787856658.468592:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6b480 x1874703436257280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856658.468599:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436257280:0@lo:400: 00000100:00100000:2.0:1787856658.472377:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436256768 00000100:00100000:2.0:1787856658.472397:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436256768 00000100:00100000:2.0:1787856658.472475:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787856658.472486:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436256768:12345-0@lo:400: 00000100:00100000:2.0:1787856658.472637:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436256768:12345-0@lo:400: Request processed in 152us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.472646:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787856658.472688:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436257024:0@lo:400: 00000100:00100000:2.0:1787856658.472738:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856658.472772:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436257536:0@lo:400: 00000100:00100000:2.0:1787856658.472798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856658.472826:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787856658.472834:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436256896:0@lo:400: 00000100:00100000:2.0:1787856658.472863:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856658.472882:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436257408:0@lo:400: 00000100:00100000:2.0:1787856658.472911:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856658.472943:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436256896 00000100:00100000:2.0:1787856658.472947:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436256896 00000100:00100000:2.0:1787856658.472969:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436257408 00000100:00100000:2.0:1787856658.472972:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436257408 00000100:00100000:2.0:1787856658.472994:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787856658.473000:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436256896:12345-0@lo:400: 00000100:00100000:2.0:1787856658.473036:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436256896:12345-0@lo:400: Request processed in 36us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.473063:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787856658.473077:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787856658.473083:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436257408:12345-0@lo:400: 00000100:00100000:2.0:1787856658.473113:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436257408:12345-0@lo:400: Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.473119:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787856658.473161:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d68b40 x1874703436256896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856658.473178:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436256896:0@lo:400: 00010000:00080000:2.0:1787856658.473191:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d692c0 x1874703436257408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856658.473199:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436257408:0@lo:400: 00000100:00100000:2.0:1787856658.473252:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436257024 00000100:00100000:2.0:1787856658.473256:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436257024 00000100:00100000:2.0:1787856658.473274:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787856658.473281:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436257024:12345-0@lo:400: 00000100:00100000:2.0:1787856658.473315:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436257024:12345-0@lo:400: Request processed in 34us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.473321:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787856658.473348:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436257024:0@lo:400: 00000100:00100000:3.0:1787856658.473687:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436257152 00000100:00100000:3.0:1787856658.473691:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436257152 00000100:00100000:3.0:1787856658.473726:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436257536 00000100:00100000:3.0:1787856658.473729:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436257536 00000100:00100000:3.0:1787856658.473758:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856658.473765:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7926940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436257152:12345-0@lo:400: 00000100:00100000:3.0:1787856658.473810:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7926940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436257152:12345-0@lo:400: Request processed in 45us (5902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.473816:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856658.473827:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856658.473833:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436257536:12345-0@lo:400: 00000100:00100000:3.0:1787856658.473866:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436257536:12345-0@lo:400: Request processed in 33us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.473873:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787856658.473895:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856658.473902:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856658.473905:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787856658.473938:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d6b840 x1874703436257536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856658.473948:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436257536:0@lo:400: 00000020:01000004:3.0:1787856658.474932:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787856658.474954:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9065fe89b3a0) 00000020:00000080:3.0:1787856658.474981:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1787856658.475084:0:9505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065fe85b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787856658.475089:0:9505:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065fe85b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787856658.475092:0:9505:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe85b800 3 00010000:00080000:3.0:1787856658.475129:0:9505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9065c46ee000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.106@tcp at head 00010000:00080000:0.0:1787856658.476597:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c5d69a40 x1874703436257152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856658.476618:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436257152:0@lo:400: 00000100:00100000:0.0:1787856658.476720:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436256768:0@lo:400: 00000100:00100000:1.0:1787856658.477333:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ec780 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9506:1874703436257664:0@lo:901: 00000100:00100000:1.0:1787856658.477784:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856658.477823:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9dcfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856658.480282:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436257664 00000100:00100000:0.0:1787856658.480306:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436257664 00000100:00100000:0.0:1787856658.483710:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787856658.483729:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9506:x1874703436257664:12345-0@lo:901: 00000100:00100000:0.0:1787856658.487814:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9506:x1874703436257664:12345-0@lo:901: Request processed in 4078us (10017us total) trans 0 rc 0/0 00010000:00080000:1.0:1787856658.487831:0:9506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c70ec780 x1874703436257664/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787856674 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856658.487832:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856658.487850:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ec780 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9506:1874703436257664:0@lo:901: 00000100:00080000:0.0:1787856658.487881:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787856658.490052:0:9505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787856658.490320:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787856658.490381:0:9505:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787856658.490395:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc25410d92a3c394d 00000100:00080000:3.0:1787856658.490406:0:9505:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787856658.490419:0:9505:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9065c46ee000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856658.490458:0:9505:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9066008dd2c0 x1874703436257792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856658.490481:0:9505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787856658.492486:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874703436257792:0@lo:38: 00000100:00100000:0.0:1787856658.492594:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856658.493015:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436257792 00000100:00100000:3.0:1787856658.493029:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436257792 00000100:00100000:3.0:1787856658.493087:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856658.493097:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874703436257792:12345-0@lo:38: 00010000:00080000:3.0:1787856658.493130:0:6496:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1787856658.493170:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc25410d92a3c3954 00000004:00100000:3.0:1787856658.493187:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787856658.493253:0:6496:0:(import.c:65:import_set_state_nolock()) ffff9066018a2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856658.493336:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874703436257792:12345-0@lo:38: Request processed in 240us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856658.493344:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787856658.494480:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9066008dd2c0 x1874703436257792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856658.494497:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787856658.494509:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787856658.494519:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787856658.494526:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787856658.494530:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065c46ee000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787856658.494537:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874703436257792:0@lo:38: 00000040:00080000:0.0:1787856658.498836:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1787856658.499136:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1787856658.499190:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787856658.499262:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.499296:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787856658.499385:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787856658.499388:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787856658.499389:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856658.499390:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856658.499392:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856658.499394:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856658.499396:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787856658.499398:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856658.499400:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856658.499403:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856658.499405:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787856658.499411:0:9488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787856658.499414:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787856658.499415:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787856658.499417:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856658.499418:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856658.499419:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856658.499420:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856658.499421:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787856658.499423:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787856658.499424:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787856658.499425:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856658.499426:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787856658.499476:0:9488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787856658.499505:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436257920:0@lo:253: 00000100:00100000:2.0:1787856658.499612:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856658.499787:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f737cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856658.499908:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436257920 00000100:00100000:0.0:1787856658.499917:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436257920 00000100:00100000:0.0:1787856658.499975:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787856658.499985:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436257920:12345-0@lo:253: 20000000:01000000:0.0:1787856658.500018:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787856658.500037:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787856658.509843:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787856658.509870:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787856658.510058:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787856658.510065:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787856658.510105:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.510129:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.510137:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.510145:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.510199:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.510275:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 17 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856658.510297:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ec780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436258048:0@lo:104: 00000100:00100000:1.0:1787856658.510411:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856658.510474:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.510483:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 17 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856658.510492:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436258176:0@lo:104: 00000100:00100000:1.0:1787856658.510513:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856658.510537:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9c113c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856658.510772:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436258048 00000100:00100000:2.0:1787856658.510782:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436258048 00000100:00100000:2.0:1787856658.510834:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436258176 00000100:00100000:2.0:1787856658.510838:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436258176 00000100:00100000:2.0:1787856658.510855:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787856658.510875:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70eed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6512:x1874703436258048:12345-0@lo:104: 00010000:00010000:2.0:1787856658.510891:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.510960:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787856658.510967:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70eed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:6512:x1874703436258048:12345-0@lo:104: Request processed in 94us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.510975:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787856658.510997:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787856658.511004:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6512:x1874703436258176:12345-0@lo:104: 00010000:00010000:2.0:1787856658.511012:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.511045:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787856658.511050:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:6512:x1874703436258176:12345-0@lo:104: Request processed in 48us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.511057:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787856658.511146:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856658.511153:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.511159:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274b600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856658.511163:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.511169:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856658.511176:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856658.511179:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856658.511280:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.511286:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856658.511303:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.511308:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c38c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c38cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.511319:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856658.511321:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.511325:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37ca00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856658.511327:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.511331:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856658.511334:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856658.511337:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787856658.511528:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856658.511596:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:9488:x1874703436257920:12345-0@lo:253: Request processed in 11606us (11981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.511614:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787856658.511703:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c911024a-9030-4ea8-a782-9255ee9580a7:9488:1874703436257920:0@lo:253: 10000000:01000000:0.0:1787856658.511720:0:9488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787856658.511724:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787856658.511727:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787856658.511729:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856658.511730:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856658.511732:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856658.511733:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856658.511735:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787856658.511737:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787856658.511738:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787856658.511740:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856658.511741:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787856658.511761:0:9488:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787856658.515856:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.515882:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856658.515902:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.515936:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c3890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856658.515971:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856658.515974:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856658.515976:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856658.516004:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436258304:0@lo:103: 00000100:00100000:1.0:1787856658.516102:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856658.516307:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856658.516315:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436258432:0@lo:103: 00000100:00100000:1.0:1787856658.517453:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1787856658.520477:0:9488:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787856658.520950:0:9488:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787856658.521165:0:9488:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787856658.523375:0:9488:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787856658.524045:0:9488:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787856658.524356:0:9488:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1787856658.525372:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ec780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436258048:0@lo:104: 00000100:00100000:0.0:1787856658.525391:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1874703436258176:0@lo:104: 00000100:00100000:2.0:1787856658.525410:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436258304 00000100:00100000:2.0:1787856658.525419:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436258304 00010000:00010000:0.0:1787856658.525427:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.525469:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 17 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856658.525517:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436258432 00000100:00100000:2.0:1787856658.525521:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436258432 00000100:00100000:0.0:1787856658.525531:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787856658.525536:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 18 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856658.525542:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+18:3623:x1874703436258304:12345-0@lo:103: 00010000:00010000:0.0:1787856658.525559:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787856658.525560:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787856658.525566:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+18:3623:x1874703436258432:12345-0@lo:103: 00010000:00010000:0.0:1787856658.525578:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 18 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.525580:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856658.525584:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 18 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.525590:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 18 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.528877:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 18 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.528918:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c38cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c38c8 expref: 18 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.528919:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3890 expref: 18 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.528939:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.528950:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.528960:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:2.0:1787856658.528977:0:8425:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018913002s 00010000:00010000:2.0:1787856658.528983:0:8425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.528991:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.528998:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.529004:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.529010:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37d000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856658.529014:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.529037:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.529063:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856658.529077:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856658.529082:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+16:3623:x1874703436258304:12345-0@lo:103: Request processed in 3540us (12978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856658.529094:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787856658.529113:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+16:3623:x1874703436258432:12345-0@lo:103: Request processed in 3547us (11663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856658.529120:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787856658.529142:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.529152:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856658.529159:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c395b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856658.530048:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436258432:0@lo:103: 00000100:00100000:1.0:1787856658.530058:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436258304:0@lo:103: 00000001:00000004:0.0:1787856658.531107:0:9488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787856658.546206:0:9488:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787856658.546261:0:9488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787856658.546310:0:9488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787856658.546392:0:9488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787856658.546418:0:9488:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787856658.546442:0:9488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787856658.547319:0:9488:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787856658.549281:0:9488:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787856659.284960:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787856659.863713:0:9562:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787856659.866733:0:9562:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787856660.305400:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856660.817537:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856660.820613:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436258560:0@lo:13: 00000100:00100000:3.0:1787856660.820689:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856660.820809:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436258560 00000100:00100000:1.0:1787856660.820817:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436258560 00000100:00100000:1.0:1787856660.820881:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787856660.820891:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436258560:12345-0@lo:13: 00002000:00000024:1.0:1787856660.820925:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856660.820972:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436258560:12345-0@lo:13: Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856660.820979:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787856660.821025:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ef480 x1874703436258560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856660.821055:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436258560:0@lo:13: 00000100:00080000:3.0:1787856660.821504:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856661.329767:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436258688:0@lo:13: 00000100:00100000:3.0:1787856661.329840:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856661.329922:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436258688 00000100:00100000:1.0:1787856661.329929:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436258688 00000100:00100000:1.0:1787856661.329985:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787856661.329995:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436258688:12345-0@lo:13: 00002000:00000024:1.0:1787856661.330018:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:2.0:1787856661.330119:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856661.330782:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436258688:12345-0@lo:13: Request processed in 787us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856661.330792:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787856661.330816:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787856661.330948:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ef480 x1874703436258688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856661.330967:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436258688:0@lo:13: 00000100:00100000:3.0:1787856661.852920:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787856661.852959:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436258816:0@lo:41: 00000100:00100000:3.0:1787856661.853036:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856661.853650:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436258816 00000100:00100000:0.0:1787856661.853666:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436258816 00000100:00100000:0.0:1787856661.853742:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787856661.853750:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436258816:12345-0@lo:41: 00000004:00000024:0.0:1787856661.853785:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787856661.853839:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436258816:12345-0@lo:41: Request processed in 90us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856661.853846:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787856661.854088:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436258816:0@lo:41: 00000100:00100000:1.0:1787856662.354581:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856662.354609:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436258944:0@lo:41: 00000100:00100000:1.0:1787856662.354681:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856662.354900:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856662.355355:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436258944 00000100:00100000:3.0:1787856662.355364:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436258944 00000100:00100000:3.0:1787856662.355421:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787856662.355431:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436258944:12345-0@lo:41: 00000004:00000024:3.0:1787856662.355463:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787856662.355534:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436258944:12345-0@lo:41: Request processed in 104us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856662.355542:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787856662.356704:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436258944:0@lo:41: 00010000:00010000:3.0:1787856663.378461:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856663.889490:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436259072:0@lo:400: 00000100:00100000:2.0:1787856663.889529:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436259200:0@lo:400: 00000100:00100000:2.0:1787856663.896248:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896334:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436259712:0@lo:400: 00000100:00100000:2.0:1787856663.896377:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896412:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436260224:0@lo:400: 00000100:00100000:2.0:1787856663.896439:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896468:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787856663.896477:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436259584:0@lo:400: 00000100:00100000:2.0:1787856663.896503:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896524:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436260096:0@lo:400: 00000100:00100000:2.0:1787856663.896548:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896584:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436259328:0@lo:400: 00000100:00100000:2.0:1787856663.896609:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896653:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436259840:0@lo:400: 00000100:00100000:2.0:1787856663.896676:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896693:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436260352:0@lo:400: 00000100:00100000:2.0:1787856663.896718:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896736:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787856663.896742:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436259456:0@lo:400: 00000100:00100000:2.0:1787856663.896763:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896781:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436259968:0@lo:400: 00000100:00100000:2.0:1787856663.896818:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856663.896850:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436259712 00000100:00100000:2.0:1787856663.896856:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436259712 00000100:00100000:2.0:1787856663.896910:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436260096 00000100:00100000:2.0:1787856663.896913:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436260096 00000100:00100000:2.0:1787856663.896930:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856663.896937:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436259712:12345-0@lo:400: 00000100:00100000:2.0:1787856663.896990:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436259712:12345-0@lo:400: Request processed in 52us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856663.896998:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856663.897015:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787856663.897265:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436260096:12345-0@lo:400: 00000100:00100000:2.0:1787856663.897301:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436260096:12345-0@lo:400: Request processed in 279us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856663.897320:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787856663.897341:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436259200 00000100:00100000:2.0:1787856663.897346:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436259200 00000100:00100000:2.0:1787856663.897365:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436260224 00000100:00100000:2.0:1787856663.897367:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436260224 00000100:00100000:2.0:1787856663.897378:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436259840 00000100:00100000:2.0:1787856663.897387:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436259840 00000100:00100000:2.0:1787856663.897401:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436260352 00000100:00100000:2.0:1787856663.897403:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436260352 00000100:00100000:2.0:1787856663.897415:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436259456 00000100:00100000:2.0:1787856663.897418:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436259456 00000100:00100000:2.0:1787856663.897427:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436259968 00000100:00100000:2.0:1787856663.897430:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436259968 00000100:00100000:2.0:1787856663.897443:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787856663.897449:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436259200:12345-0@lo:400: 00000100:00100000:2.0:1787856663.897482:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436259200:12345-0@lo:400: Request processed in 33us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856663.897489:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787856663.897501:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787856663.897507:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436260224:12345-0@lo:400: 00000100:00100000:2.0:1787856663.897532:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436260224:12345-0@lo:400: Request processed in 26us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856663.897537:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787856663.897548:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787856663.897553:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436259840:12345-0@lo:400: 00000100:00100000:2.0:1787856663.897585:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436259840:12345-0@lo:400: Request processed in 32us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856663.897591:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787856663.897602:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787856663.897607:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436260352:12345-0@lo:400: 00000100:00100000:2.0:1787856663.897633:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436260352:12345-0@lo:400: Request processed in 26us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856663.897639:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787856663.897649:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787856663.897663:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436259456:12345-0@lo:400: 00000100:00100000:2.0:1787856663.897693:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436259456:12345-0@lo:400: Request processed in 32us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856663.897698:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787856663.897711:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787856663.897717:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436259968:12345-0@lo:400: 00000100:00100000:2.0:1787856663.897742:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436259968:12345-0@lo:400: Request processed in 26us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856663.897748:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787856663.898750:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856663.898794:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436259584 00000100:00100000:0.0:1787856663.898800:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436259584 00000100:00100000:0.0:1787856663.898837:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436259328 00000100:00100000:0.0:1787856663.898841:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436259328 00000100:00100000:0.0:1787856663.898856:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787856663.898863:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436259584:12345-0@lo:400: 00000100:00100000:0.0:1787856663.898906:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436259584:12345-0@lo:400: Request processed in 44us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856663.898913:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787856663.898927:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787856663.898933:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436259328:12345-0@lo:400: 00000100:00100000:0.0:1787856663.898958:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436259328:12345-0@lo:400: Request processed in 25us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856663.898964:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787856663.899001:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436259072 00000100:00100000:0.0:1787856663.899005:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436259072 00000100:00100000:0.0:1787856663.899031:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787856663.899038:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:3625:x1874703436259072:12345-0@lo:400: 00000100:00100000:0.0:1787856663.899081:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:3625:x1874703436259072:12345-0@lo:400: Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856663.899088:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787856663.899145:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436259072:0@lo:400: 00000100:00080000:2.0:1787856663.899158:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856663.899162:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856663.899165:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787856663.899194:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7bec000 x1874703436259456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856663.899207:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436259456:0@lo:400: 00010000:00080000:2.0:1787856663.899243:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7bef480 x1874703436259968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856663.899252:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436259968:0@lo:400: 00000100:00100000:2.0:1787856663.899264:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436259328:0@lo:400: 00010000:00080000:2.0:1787856663.899274:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7bef840 x1874703436259840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856663.899281:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436259840:0@lo:400: 00010000:00080000:2.0:1787856663.899292:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7becb40 x1874703436260352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856663.899324:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436260352:0@lo:400: 00000100:00100000:2.0:1787856663.899365:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436259584:0@lo:400: 00010000:00080000:2.0:1787856663.899378:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7beda40 x1874703436260096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856663.899387:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436260096:0@lo:400: 00010000:00080000:2.0:1787856663.899399:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe80f480 x1874703436259200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856663.899406:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436259200:0@lo:400: 00010000:00080000:2.0:1787856663.899417:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7befc00 x1874703436259712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856663.899425:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436259712:0@lo:400: 00010000:00080000:2.0:1787856663.899436:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7bef0c0 x1874703436260224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856663.899445:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436260224:0@lo:400: 00010000:00010000:1.0:1787856664.402851:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787856665.425690:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787856665.425705:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065fe6d5000 from 39 10000000:01000000:1.0:1787856665.425710:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787856665.425751:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856665.425764:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856665.425776:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856665.425799:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436260480:0@lo:101: 00000100:00100000:1.0:1787856665.425877:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856665.425918:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.426039:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436260480 00000100:00100000:0.0:1787856665.426046:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436260480 00000100:00100000:0.0:1787856665.426101:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787856665.426110:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436260480:12345-0@lo:101: 00010000:00010000:0.0:1787856665.426124:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856665.426136:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3962 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.426160:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.426172:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.426181:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ffa00, rc 0) 00000100:00100000:0.0:1787856665.426245:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436260480:12345-0@lo:101: Request processed in 136us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.426252:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787856665.426307:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436260480:0@lo:101: 00010000:00010000:0.0:1787856665.426322:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.426332:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856665.426400:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436260608:0@lo:501: 00000100:00100000:0.0:1787856665.426426:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.426447:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.426460:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436260608 00000100:00100000:0.0:1787856665.426463:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436260608 00000100:00100000:0.0:1787856665.426485:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787856665.426491:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436260608:12345-0@lo:501: 00000100:00100000:0.0:1787856665.426790:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436260608:12345-0@lo:501: Request processed in 298us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.426799:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787856665.426832:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436260608:0@lo:501: 00000100:00100000:0.0:1787856665.426860:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436260736:0@lo:503: 00000100:00100000:0.0:1787856665.426903:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.427420:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787856665.430475:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436260736 00000100:00100000:1.0:1787856665.430490:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436260736 00000100:00100000:1.0:1787856665.430547:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787856665.430559:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436260736:12345-0@lo:503: 00000100:00100000:1.0:1787856665.431026:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436260736:12345-0@lo:503: Request processed in 468us (4121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856665.431035:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787856665.431137:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436260736:0@lo:503: 00010000:00010000:2.0:1787856665.433775:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856665.438528:0:9822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9822:1874703436260864:0@lo:502: 00000100:00100000:0.0:1787856665.438680:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.438719:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436260864 00000100:00100000:0.0:1787856665.438726:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436260864 00000100:00100000:0.0:1787856665.438769:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787856665.438778:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:9822:x1874703436260864:12345-0@lo:502: 00000100:00100000:0.0:1787856665.438909:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:9822:x1874703436260864:12345-0@lo:502: Request processed in 131us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.438916:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787856665.438974:0:9822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd600 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.438994:0:9822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9822:1874703436260864:0@lo:502: 00000100:00100000:0.0:1787856665.439039:0:9822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9822:1874703436260992:0@lo:502: 00000100:00100000:0.0:1787856665.439071:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.439085:0:9822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd600 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.440492:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436260992 00000100:00100000:0.0:1787856665.440503:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436260992 00000100:00100000:0.0:1787856665.440556:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787856665.440564:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:9822:x1874703436260992:12345-0@lo:502: 00000100:00100000:0.0:1787856665.440905:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:9822:x1874703436260992:12345-0@lo:502: Request processed in 341us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.440914:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787856665.445079:0:9822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9822:1874703436260992:0@lo:502: 00000040:00080000:3.0:1787856665.445254:0:9822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787856665.445700:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787856665.445728:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787856665.445740:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856665.445752:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856665.445763:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787856665.445765:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787856665.445768:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787856665.445808:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856665.445816:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856665.445826:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856665.445846:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261120:0@lo:101: 00000100:00100000:1.0:1787856665.445917:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856665.445997:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.448512:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436261120 00000100:00100000:2.0:1787856665.448525:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436261120 00000100:00100000:3.0:1787856665.450551:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787856665.450564:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436261120:12345-0@lo:101: 00010000:00010000:3.0:1787856665.450582:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856665.450619:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3970 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856665.450649:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856665.450661:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856665.450670:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9e00, rc 0) 00000100:00100000:3.0:1787856665.450754:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436261120:12345-0@lo:101: Request processed in 191us (4835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.450773:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787856665.451640:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261120:0@lo:101: 00010000:00010000:2.0:1787856665.451663:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.451688:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.451774:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261248:0@lo:501: 00000100:00100000:2.0:1787856665.451814:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.456764:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.458888:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436261248 00000100:00100000:0.0:1787856665.458901:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436261248 00000100:00100000:0.0:1787856665.458962:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787856665.458973:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436261248:12345-0@lo:501: 00000100:00100000:0.0:1787856665.459150:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436261248:12345-0@lo:501: Request processed in 180us (7335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.459158:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787856665.459233:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261248:0@lo:501: 00000100:00100000:0.0:1787856665.459542:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7925e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261376:0@lo:503: 00000100:00100000:0.0:1787856665.459609:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.459640:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.459652:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436261376 00000100:00100000:0.0:1787856665.459656:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436261376 00000100:00100000:0.0:1787856665.459685:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787856665.459692:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436261376:12345-0@lo:503: 00000100:00100000:0.0:1787856665.459780:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436261376:12345-0@lo:503: Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.459787:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787856665.459826:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7925e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261376:0@lo:503: 00000100:00100000:0.0:1787856665.460002:0:9825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7925e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9825:1874703436261504:0@lo:502: 00000100:00100000:0.0:1787856665.460037:0:9825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.460054:0:9825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787856665.460832:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436261504 00000100:00100000:3.0:1787856665.460838:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436261504 00000100:00100000:3.0:1787856665.460873:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787856665.460881:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:9825:x1874703436261504:12345-0@lo:502: 00000100:00100000:3.0:1787856665.460981:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:9825:x1874703436261504:12345-0@lo:502: Request processed in 101us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.460988:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787856665.461095:0:9825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7925e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9825:1874703436261504:0@lo:502: 00000020:01000000:0.0:1787856665.461121:0:9825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856665.461131:0:9825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856665.461134:0:9825:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787856665.461139:0:9825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787856665.461142:0:9825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787856665.461162:0:9825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7925e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9825:1874703436261632:0@lo:502: 00000100:00100000:0.0:1787856665.461201:0:9825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.461254:0:9825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787856665.461427:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436261632 00000100:00100000:3.0:1787856665.461432:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436261632 00000100:00100000:3.0:1787856665.461494:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787856665.461502:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:9825:x1874703436261632:12345-0@lo:502: 00000100:00100000:3.0:1787856665.461578:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:9825:x1874703436261632:12345-0@lo:502: Request processed in 76us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.461586:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787856665.461711:0:9825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7925e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9825:1874703436261632:0@lo:502: 00000020:01000000:1.0:1787856665.461734:0:9825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856665.461739:0:9825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856665.461741:0:9825:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787856665.461745:0:9825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787856665.467849:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787856665.467888:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787856665.467901:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856665.467913:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856665.467924:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787856665.467927:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065f7199800 from 39 10000000:01000000:1.0:1787856665.467930:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787856665.467965:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856665.467973:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856665.467986:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856665.468010:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261760:0@lo:101: 00000100:00100000:1.0:1787856665.468076:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856665.470084:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.473001:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436261760 00000100:00100000:0.0:1787856665.473016:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436261760 00000100:00100000:0.0:1787856665.473077:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787856665.473086:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436261760:12345-0@lo:101: 00010000:00010000:0.0:1787856665.473104:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856665.473121:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c397e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.473150:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c397e expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.473175:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c397e expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.473184:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fec00, rc 0) 00000100:00100000:0.0:1787856665.473328:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436261760:12345-0@lo:101: Request processed in 241us (5251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.473335:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787856665.473383:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261760:0@lo:101: 00010000:00010000:0.0:1787856665.473402:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.473412:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856665.473494:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261888:0@lo:501: 00000100:00100000:0.0:1787856665.473533:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.473557:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.473576:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436261888 00000100:00100000:0.0:1787856665.473580:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436261888 00000100:00100000:0.0:1787856665.473609:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787856665.473616:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436261888:12345-0@lo:501: 00000100:00100000:0.0:1787856665.473742:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436261888:12345-0@lo:501: Request processed in 127us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.473749:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787856665.473771:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436261888:0@lo:501: 00000100:00100000:0.0:1787856665.473801:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262016:0@lo:503: 00000100:00100000:0.0:1787856665.473850:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.473859:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.473876:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436262016 00000100:00100000:0.0:1787856665.473880:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436262016 00000100:00100000:0.0:1787856665.473895:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787856665.473901:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436262016:12345-0@lo:503: 00000100:00100000:0.0:1787856665.473973:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436262016:12345-0@lo:503: Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.473981:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787856665.474012:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262016:0@lo:503: 00000100:00100000:0.0:1787856665.474237:0:9828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9828:1874703436262144:0@lo:502: 00000100:00100000:0.0:1787856665.474271:0:9828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.474290:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436262144 00000100:00100000:0.0:1787856665.474305:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436262144 00000100:00100000:0.0:1787856665.474324:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787856665.474330:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:9828:x1874703436262144:12345-0@lo:502: 00000100:00100000:0.0:1787856665.474400:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:9828:x1874703436262144:12345-0@lo:502: Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.474407:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787856665.474439:0:9828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.474451:0:9828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9828:1874703436262144:0@lo:502: 00000100:00100000:0.0:1787856665.474486:0:9828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9828:1874703436262272:0@lo:502: 00000100:00100000:0.0:1787856665.474514:0:9828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.474531:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436262272 00000100:00100000:0.0:1787856665.474535:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436262272 00000100:00100000:0.0:1787856665.474550:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787856665.474561:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:9828:x1874703436262272:12345-0@lo:502: 00000100:00100000:0.0:1787856665.474612:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:9828:x1874703436262272:12345-0@lo:502: Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.474619:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787856665.474643:0:9828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.474653:0:9828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9828:1874703436262272:0@lo:502: 00000040:00080000:0.0:1787856665.474670:0:9828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787856665.474726:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787856665.474742:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787856665.474751:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.474761:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856665.474771:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787856665.474774:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065f7199800 from 6 10000000:01000000:0.0:1787856665.474777:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787856665.474798:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.474807:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.474817:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856665.474829:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262400:0@lo:101: 00000100:00100000:0.0:1787856665.474853:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.474872:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.474883:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436262400 00000100:00100000:0.0:1787856665.474887:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436262400 00000100:00100000:0.0:1787856665.474905:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787856665.474910:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436262400:12345-0@lo:101: 00010000:00010000:0.0:1787856665.474918:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856665.474930:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5fe200/0xc25410d92a3c3993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c398c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.474947:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5fe200/0xc25410d92a3c3993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c398c expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.474958:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5fe200/0xc25410d92a3c3993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c398c expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.474967:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe200, rc 0) 00000100:00100000:0.0:1787856665.474992:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436262400:12345-0@lo:101: Request processed in 81us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.474998:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787856665.475025:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262400:0@lo:101: 00010000:00010000:0.0:1787856665.475036:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.475044:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856665.475082:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262528:0@lo:256: 00000100:00100000:0.0:1787856665.475111:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.475124:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.475140:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436262528 00000100:00100000:0.0:1787856665.475143:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436262528 00000100:00100000:0.0:1787856665.475159:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787856665.475165:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436262528:12345-0@lo:256: 20000000:01000000:0.0:1787856665.475176:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787856665.475192:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787856665.475195:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787856665.475322:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436262528:12345-0@lo:256: Request processed in 156us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.475329:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787856665.475356:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262528:0@lo:256: 10000000:01000000:0.0:1787856665.475391:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787856665.475397:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.475404:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856665.475410:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787856665.475412:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1787856665.475415:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787856665.475428:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.475435:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.475441:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856665.475464:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262656:0@lo:101: 00000100:00100000:0.0:1787856665.475488:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.475507:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.475518:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436262656 00000100:00100000:0.0:1787856665.475521:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436262656 00000100:00100000:0.0:1787856665.475537:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787856665.475543:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436262656:12345-0@lo:101: 00010000:00010000:0.0:1787856665.475550:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856665.475558:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c399a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.475572:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c399a expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.475581:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c399a expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.475588:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe000, rc 0) 00000100:00100000:0.0:1787856665.475613:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436262656:12345-0@lo:101: Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.475618:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787856665.475643:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262656:0@lo:101: 00010000:00010000:0.0:1787856665.475653:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856665.475662:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856665.475713:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262784:0@lo:501: 00000100:00100000:0.0:1787856665.475737:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.475750:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.475760:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436262784 00000100:00100000:0.0:1787856665.475763:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436262784 00000100:00100000:0.0:1787856665.475779:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787856665.475784:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436262784:12345-0@lo:501: 00000100:00100000:0.0:1787856665.475874:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436262784:12345-0@lo:501: Request processed in 89us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.475881:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787856665.475907:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262784:0@lo:501: 00000100:00100000:0.0:1787856665.475933:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262912:0@lo:503: 00000100:00100000:0.0:1787856665.475970:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.475983:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.475994:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436262912 00000100:00100000:0.0:1787856665.475997:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436262912 00000100:00100000:0.0:1787856665.476013:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787856665.476018:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436262912:12345-0@lo:503: 00000100:00100000:0.0:1787856665.476091:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436262912:12345-0@lo:503: Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.476098:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787856665.476132:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436262912:0@lo:503: 00000100:00100000:3.0:1787856665.476843:0:9829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9829:1874703436263040:0@lo:502: 00000100:00100000:3.0:1787856665.476889:0:9829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.476920:0:9829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001240 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.477284:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436263040 00000100:00100000:2.0:1787856665.477291:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436263040 00000100:00100000:2.0:1787856665.477333:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787856665.477341:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:9829:x1874703436263040:12345-0@lo:502: 00000100:00100000:2.0:1787856665.477436:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:9829:x1874703436263040:12345-0@lo:502: Request processed in 95us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.477444:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787856665.477621:0:9829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9829:1874703436263040:0@lo:502: 00000020:01000000:3.0:1787856665.477647:0:9829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787856665.477655:0:9829:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787856665.477661:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856665.477664:0:9829:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787856665.477669:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787856665.477672:0:9829:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:3.0:1787856665.477702:0:9829:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787856665.477712:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787856665.477728:0:9829:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9065fe89cd70) 00000020:00000080:3.0:1787856665.477752:0:9829:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787856665.477759:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787856665.477838:0:9829:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787856665.477846:0:9829:0:(osd_handler.c:8928:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787856665.477853:0:9829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c39af 00010000:00080000:3.0:1787856665.477883:0:9829:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90660191a000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1787856665.478126:0:9829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1787856665.478535:0:9829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787856665.478548:0:9829:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787856665.478844:0:9829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856665.478953:0:9829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856665.479083:0:9829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787856665.479164:0:9829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787856665.485850:0:9830:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787856665.485859:0:9830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787856665.491310:0:9829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787856665.491326:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787856665.491374:0:9829:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787856665.491402:0:9829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c39b6 00000100:00080000:1.0:1787856665.491413:0:9829:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856665.491419:0:9829:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90660191a000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856665.491465:0:9829:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c70ec780 x1874703436263168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856665.491488:0:9829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787856665.491546:0:9829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856665.491551:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856665.491553:0:9829:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787856665.491555:0:9829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856665.491559:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856665.491560:0:9829:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787856665.491563:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787856665.491565:0:9829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787856665.491605:0:9829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9829:1874703436263296:0@lo:502: 00000100:00100000:1.0:1787856665.491887:0:9829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.492040:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436263424:0@lo:400: 00000100:00100000:3.0:1787856665.492074:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.492107:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436263936:0@lo:400: 00000100:00100000:3.0:1787856665.492131:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.492147:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436264448:0@lo:400: 00000100:00100000:3.0:1787856665.492169:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.492189:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787856665.492195:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436263808:0@lo:400: 00000100:00100000:3.0:1787856665.492233:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.492251:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436264320:0@lo:400: 00000100:00100000:0.0:1787856665.492394:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436263168:0@lo:8: 00000100:00100000:3.0:1787856665.494715:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.494799:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436263552:0@lo:400: 00000100:00100000:3.0:1787856665.494855:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.494885:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436264064:0@lo:400: 00000100:00100000:3.0:1787856665.494911:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.494929:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436264576:0@lo:400: 00000100:00100000:3.0:1787856665.494953:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.494974:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787856665.494981:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436263680:0@lo:400: 00000100:00100000:3.0:1787856665.495000:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.495014:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436264192:0@lo:400: 00000100:00100000:3.0:1787856665.495034:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.495062:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436263424 00000100:00100000:3.0:1787856665.495070:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436263424 00000100:00100000:3.0:1787856665.495107:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436264448 00000100:00100000:3.0:1787856665.495111:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436264448 00000100:00100000:3.0:1787856665.495134:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436264064 00000100:00100000:3.0:1787856665.495136:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436264064 00000100:00100000:3.0:1787856665.495148:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436264576 00000100:00100000:3.0:1787856665.495150:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436264576 00000100:00100000:3.0:1787856665.495161:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436263680 00000100:00100000:3.0:1787856665.495163:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436263680 00000100:00100000:3.0:1787856665.495173:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436264192 00000100:00100000:3.0:1787856665.495176:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436264192 00000100:00100000:3.0:1787856665.495189:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856665.495197:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436263424:12345-0@lo:400: 00000100:00100000:3.0:1787856665.495269:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436263424:12345-0@lo:400: Request processed in 72us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.495668:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856665.495690:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856665.495707:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436264448:12345-0@lo:400: 00000100:00100000:3.0:1787856665.495741:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436264448:12345-0@lo:400: Request processed in 36us (3570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.495753:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856665.495766:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856665.495772:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436264064:12345-0@lo:400: 00000100:00100000:3.0:1787856665.495804:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436264064:12345-0@lo:400: Request processed in 32us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.495810:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856665.495821:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787856665.495827:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436264576:12345-0@lo:400: 00000100:00100000:3.0:1787856665.495854:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436264576:12345-0@lo:400: Request processed in 28us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.495860:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787856665.495871:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787856665.495876:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436263680:12345-0@lo:400: 00000100:00100000:3.0:1787856665.495902:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436263680:12345-0@lo:400: Request processed in 26us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.495909:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787856665.495921:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787856665.495927:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436264192:12345-0@lo:400: 00000100:00100000:3.0:1787856665.495951:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436264192:12345-0@lo:400: Request processed in 24us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.495957:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787856665.495976:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436263936 00000100:00100000:3.0:1787856665.495980:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436263936 00000100:00100000:3.0:1787856665.496006:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436264320 00000100:00100000:3.0:1787856665.496010:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436264320 00000100:00100000:3.0:1787856665.496024:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856665.496039:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436263936:12345-0@lo:400: 00000100:00100000:3.0:1787856665.496071:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436263936:12345-0@lo:400: Request processed in 34us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.496077:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856665.496090:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787856665.496096:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436264320:12345-0@lo:400: 00000100:00100000:3.0:1787856665.496122:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436264320:12345-0@lo:400: Request processed in 27us (3848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.496128:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787856665.496149:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436263808 00000100:00100000:3.0:1787856665.496153:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436263808 00000100:00100000:3.0:1787856665.496168:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436263552 00000100:00100000:3.0:1787856665.496171:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436263552 00000100:00100000:3.0:1787856665.496182:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787856665.496188:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436263808:12345-0@lo:400: 00000100:00100000:3.0:1787856665.496237:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436263808:12345-0@lo:400: Request processed in 29us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.496244:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787856665.496256:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787856665.496261:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436263552:12345-0@lo:400: 00000100:00100000:3.0:1787856665.496419:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436263552:12345-0@lo:400: Request processed in 157us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.496428:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787856665.496453:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787856665.496516:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856665.496521:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856665.496523:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856665.496531:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436263168 00000100:00100000:3.0:1787856665.496540:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436263168 00000100:00100000:3.0:1787856665.496560:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856665.496564:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436263168:12345-0@lo:8: 00010000:00080000:3.0:1787856665.496590:0:8409:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000100:00100000:1.0:1787856665.497249:0:9829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f56c0 going to sleep for 11 seconds 00000020:00000080:3.0:1787856665.497780:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c39bd 00002000:00100000:3.0:1787856665.497797:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90660191a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787856665.497803:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1787856665.497808:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787856665.497886:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787856665.498142:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787856665.498173:0:8409:0:(import.c:65:import_set_state_nolock()) ffff90660191e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856665.498273:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1874703436263168:12345-0@lo:8: Request processed in 1706us (1818us total) trans 0 rc 0/0 00010000:00080000:1.0:1787856665.498449:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ec780 x1874703436263168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787856675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856665.498461:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787856665.498469:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787856665.498477:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787856665.498482:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787856665.498484:0:3622:0:(import.c:65:import_set_state_nolock()) ffff90660191a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787856665.498512:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787856665.498519:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436263168:0@lo:8: 00000004:00080000:1.0:1787856665.498548:0:9830:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787856665.498681:0:9830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 199208462951ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787856665.498688:0:9830:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787856665.498738:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787856665.498786:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008dc780 x1874703436263680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.498798:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436263680:0@lo:400: 00010000:00080000:3.0:1787856665.498810:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008e0b40 x1874703436264192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.498818:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436264192:0@lo:400: 00000100:00100000:3.0:1787856665.498829:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436263552:0@lo:400: 00010000:00080000:3.0:1787856665.498840:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008de1c0 x1874703436264064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.498847:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436264064:0@lo:400: 00010000:00080000:3.0:1787856665.498859:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008e2940 x1874703436264576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.498876:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436264576:0@lo:400: 00000100:00100000:3.0:1787856665.498913:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436263808:0@lo:400: 00010000:00080000:3.0:1787856665.498926:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008e3480 x1874703436264320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.498935:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436264320:0@lo:400: 00010000:00080000:3.0:1787856665.498946:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008df480 x1874703436263424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.498953:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436263424:0@lo:400: 00010000:00080000:3.0:1787856665.498963:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008dd680 x1874703436263936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.498970:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436263936:0@lo:400: 00010000:00080000:3.0:1787856665.498981:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008e30c0 x1874703436264448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.498989:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436264448:0@lo:400: 00000100:00100000:2.0:1787856665.499133:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436263296 00000100:00100000:2.0:1787856665.499140:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436263296 00000100:00100000:2.0:1787856665.499183:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787856665.499193:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:9829:x1874703436263296:12345-0@lo:502: 00000100:00100000:2.0:1787856665.499363:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:9829:x1874703436263296:12345-0@lo:502: Request processed in 171us (7669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.499370:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787856665.500871:0:9829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9829:1874703436263296:0@lo:502: 00000020:01000000:1.0:1787856665.500924:0:9829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856665.500932:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856665.500935:0:9829:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787856665.500940:0:9829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1787856665.501997:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787856665.502024:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787856665.502036:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.502047:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856665.502072:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787856665.502075:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065d3be8000 from 39 10000000:01000000:2.0:1787856665.502077:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787856665.502113:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.502123:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.502132:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.502152:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436264704:0@lo:101: 00000100:00100000:2.0:1787856665.502212:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856665.502511:0:9832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9832:1874703436264832:0@lo:700: 00000100:00100000:1.0:1787856665.502543:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.502659:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.502678:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436264704 00000100:00100000:2.0:1787856665.502683:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436264704 00000100:00100000:2.0:1787856665.502724:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787856665.502732:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436264704:12345-0@lo:101: 00010000:00010000:2.0:1787856665.502745:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856665.502757:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c39c4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.502782:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.502794:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.502815:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a000, rc 0) 00000100:00100000:2.0:1787856665.502852:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436264704:12345-0@lo:101: Request processed in 121us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.502860:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787856665.502935:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436264704:0@lo:101: 00010000:00010000:2.0:1787856665.502950:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.502959:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.503040:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436264960:0@lo:501: 00000100:00100000:2.0:1787856665.503064:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.503079:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d180 going to sleep for 11 seconds 00000004:00080000:2.0:1787856665.503138:0:7428:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787856665.503379:0:9832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.503446:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436264960 00000100:00100000:2.0:1787856665.503451:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436264960 00000100:00100000:2.0:1787856665.503487:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787856665.503494:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436264960:12345-0@lo:501: 00000100:00100000:2.0:1787856665.504026:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436264960:12345-0@lo:501: Request processed in 531us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.504034:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787856665.504076:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436264960:0@lo:501: 00000100:00100000:2.0:1787856665.504110:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265088:0@lo:503: 00000100:00100000:2.0:1787856665.504152:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.504175:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.504198:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436265088 00000100:00100000:2.0:1787856665.504202:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436265088 00000100:00100000:2.0:1787856665.504248:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787856665.504255:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436265088:12345-0@lo:503: 00000100:00100000:2.0:1787856665.504349:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436265088:12345-0@lo:503: Request processed in 94us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.504355:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787856665.504394:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265088:0@lo:503: 00000100:00100000:2.0:1787856665.506901:0:9834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9834:1874703436265216:0@lo:502: 00000100:00100000:2.0:1787856665.506979:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.507055:0:9834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5840 going to sleep for 11 seconds 00000100:00100000:3.0:1787856665.507247:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436264832 00000100:00100000:3.0:1787856665.507253:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436264832 00000100:00100000:0.0:1787856665.509327:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436265216 00000100:00100000:0.0:1787856665.509344:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436265216 00000100:00100000:0.0:1787856665.509437:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787856665.509448:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:9834:x1874703436265216:12345-0@lo:502: 00000100:00100000:0.0:1787856665.509606:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:9834:x1874703436265216:12345-0@lo:502: Request processed in 147us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.509615:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1787856665.509759:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856665.509796:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856665.509804:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9832:x1874703436264832:12345-0@lo:700: 00000100:00100000:3.0:1787856665.509854:0:8416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8416:1874703436265344:0@lo:700: 00000100:00100000:3.0:1787856665.509892:0:8416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.509916:0:8416:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856665.509937:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436265344 00000100:00100000:3.0:1787856665.509941:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436265344 00000100:00100000:3.0:1787856665.509966:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856665.509973:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8416:x1874703436265344:12345-0@lo:700: 00000100:00100000:3.0:1787856665.511497:0:9834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9834:1874703436265216:0@lo:502: 00000100:00100000:3.0:1787856665.511571:0:9834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9834:1874703436265472:0@lo:502: 00000100:00100000:3.0:1787856665.511696:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.511961:0:9834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.512050:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436265472 00000100:00100000:2.0:1787856665.512057:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436265472 00000100:00100000:2.0:1787856665.512102:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787856665.512112:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:9834:x1874703436265472:12345-0@lo:502: 00000100:00100000:2.0:1787856665.512327:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:9834:x1874703436265472:12345-0@lo:502: Request processed in 215us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.512335:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787856665.512509:0:9834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9834:1874703436265472:0@lo:502: 00000040:00080000:3.0:1787856665.512533:0:9834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787856665.519076:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787856665.519115:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787856665.519127:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.519139:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856665.519149:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787856665.519160:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065d3be8000 from 6 10000000:01000000:2.0:1787856665.519164:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787856665.519203:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.519212:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.519249:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.519280:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265600:0@lo:101: 00000100:00100000:2.0:1787856665.519360:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.519397:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.519418:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436265600 00000100:00100000:2.0:1787856665.519423:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436265600 00000100:00100000:2.0:1787856665.519467:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787856665.519476:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436265600:12345-0@lo:101: 00010000:00010000:2.0:1787856665.519488:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856665.519499:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076aa00/0xc25410d92a3c39d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c39d2 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.519536:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076aa00/0xc25410d92a3c39d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c39d2 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.519547:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076aa00/0xc25410d92a3c39d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c39d2 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.519557:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076aa00, rc 0) 00000100:00100000:2.0:1787856665.519590:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436265600:12345-0@lo:101: Request processed in 115us (230us total) trans 0 rc 0/0 40000000:02000000:1.0:1787856665.520930:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1787856665.521568:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787856665.521744:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265600:0@lo:101: 00010000:00010000:2.0:1787856665.521768:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.521779:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.521844:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265728:0@lo:256: 00000100:00100000:2.0:1787856665.521907:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.521950:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856665.522777:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436265728 00000100:00100000:3.0:1787856665.522784:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436265728 00000100:00100000:3.0:1787856665.522828:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787856665.522836:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436265728:12345-0@lo:256: 20000000:01000000:3.0:1787856665.522857:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787856665.522875:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787856665.522879:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787856665.522969:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436265728:12345-0@lo:256: Request processed in 132us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.522977:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787856665.523075:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265728:0@lo:256: 10000000:01000000:2.0:1787856665.523123:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787856665.523131:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.523141:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856665.523151:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787856665.523154:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787856665.523157:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787856665.523182:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.523191:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.523211:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.523700:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265856:0@lo:101: 00000100:00100000:2.0:1787856665.523735:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.523764:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.523779:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436265856 00000100:00100000:2.0:1787856665.523783:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436265856 00000100:00100000:2.0:1787856665.523813:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787856665.523820:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436265856:12345-0@lo:101: 00010000:00010000:2.0:1787856665.523830:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856665.523843:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c39e0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.523863:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.523874:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.523882:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b800, rc 0) 00000100:00100000:2.0:1787856665.523910:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436265856:12345-0@lo:101: Request processed in 90us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.523916:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787856665.523946:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265856:0@lo:101: 00010000:00010000:2.0:1787856665.523959:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.523979:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.524033:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265984:0@lo:501: 00000100:00100000:2.0:1787856665.524057:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.524071:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.524083:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436265984 00000100:00100000:2.0:1787856665.524087:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436265984 00000100:00100000:2.0:1787856665.524108:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787856665.524114:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436265984:12345-0@lo:501: 00000100:00100000:2.0:1787856665.524241:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436265984:12345-0@lo:501: Request processed in 103us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.524249:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787856665.524301:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436265984:0@lo:501: 00000100:00100000:2.0:1787856665.524327:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436266112:0@lo:503: 00000100:00100000:2.0:1787856665.524368:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.524382:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.524393:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436266112 00000100:00100000:2.0:1787856665.524396:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436266112 00000100:00100000:2.0:1787856665.524416:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787856665.524422:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436266112:12345-0@lo:503: 00000100:00100000:2.0:1787856665.524501:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436266112:12345-0@lo:503: Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.524508:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787856665.524547:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436266112:0@lo:503: 00000100:00100000:3.0:1787856665.530957:0:9839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9839:1874703436266240:0@lo:502: 00000100:00100000:3.0:1787856665.531047:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.531093:0:9839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.531153:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436266240 00000100:00100000:2.0:1787856665.531161:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436266240 00000100:00100000:2.0:1787856665.531213:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787856665.531245:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:9839:x1874703436266240:12345-0@lo:502: 00000100:00100000:2.0:1787856665.531379:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:9839:x1874703436266240:12345-0@lo:502: Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.531388:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787856665.531492:0:9839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9839:1874703436266240:0@lo:502: 00000020:01000000:3.0:1787856665.531523:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787856665.531531:0:9839:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787856665.531543:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856665.531545:0:9839:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787856665.531550:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787856665.531554:0:9839:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:3.0:1787856665.531574:0:9839:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787856665.531577:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787856665.531610:0:9839:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9064c8084d70) 00000020:00000080:3.0:1787856665.531636:0:9839:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787856665.531643:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787856665.531724:0:9839:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787856665.531730:0:9839:0:(osd_handler.c:8928:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787856665.531746:0:9839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c39f5 00010000:00080000:3.0:1787856665.531785:0:9839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9064c808a000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1787856665.532026:0:9839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787856665.532163:0:9839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787856665.532174:0:9839:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787856665.532384:0:9839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856665.532496:0:9839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856665.532618:0:9839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787856665.532732:0:9839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787856665.535272:0:9840:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856665.535280:0:9840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1787856665.537108:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8416:x1874703436265344:12345-0@lo:700: Request processed in 27127us (27207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856665.537127:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787856665.537185:0:8416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066007c0000 x1874703436265344/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856665.537200:0:8416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8416:1874703436265344:0@lo:700: 40000000:02000000:1.0:1787856665.537469:0:8416:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:00000080:2.0:1787856665.545490:0:9839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787856665.545507:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787856665.545553:0:9839:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787856665.545580:0:9839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c39fc 00000100:00080000:2.0:1787856665.545592:0:9839:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787856665.545677:0:9839:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9064c808a000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856665.545719:0:9839:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c7062580 x1874703436266368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787856665.545743:0:9839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787856665.545794:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856665.545798:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856665.545800:0:9839:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787856665.545804:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856665.545807:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856665.545809:0:9839:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787856665.545812:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787856665.545814:0:9839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787856665.545843:0:9839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7060780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9839:1874703436266496:0@lo:502: 00000100:00100000:2.0:1787856665.545929:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.545968:0:9839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37840 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.545995:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436266496 00000100:00100000:2.0:1787856665.546007:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436266496 00000100:00100000:2.0:1787856665.546046:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787856665.546055:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+23:9839:x1874703436266496:12345-0@lo:502: 00000100:00100000:2.0:1787856665.546166:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+23:9839:x1874703436266496:12345-0@lo:502: Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.546175:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787856665.546251:0:9839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7060780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:9839:1874703436266496:0@lo:502: 00000020:01000000:2.0:1787856665.546273:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856665.546278:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856665.546280:0:9839:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787856665.546284:0:9839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787856665.546412:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1787856665.546433:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787856665.546443:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.546454:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856665.546466:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787856665.546469:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9065e9fd0000 from 1 10000000:01000000:2.0:1787856665.546472:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787856665.546495:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.546504:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856665.546513:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.546538:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7060780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436266624:0@lo:101: 00000100:00100000:2.0:1787856665.546566:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.546588:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37840 going to sleep for 11 seconds 00000100:00100000:3.0:1787856665.550719:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436266624 00000100:00100000:3.0:1787856665.550734:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436266624 00000100:00100000:3.0:1787856665.550804:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787856665.550814:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436266624:12345-0@lo:101: 00010000:00010000:3.0:1787856665.550831:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856665.550849:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3a03 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856665.550894:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856665.550913:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856665.550923:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8000, rc 0) 00000100:00100000:3.0:1787856665.551000:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436266624:12345-0@lo:101: Request processed in 188us (4433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.551007:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787856665.551085:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7060780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436266624:0@lo:101: 00010000:00010000:3.0:1787856665.551104:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856665.551115:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856665.551185:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436266752:0@lo:501: 00000100:00100000:3.0:1787856665.551238:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.551269:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.551387:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436266752 00000100:00100000:2.0:1787856665.551393:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436266752 00000100:00100000:2.0:1787856665.551418:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787856665.551425:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436266752:12345-0@lo:501: 00000100:00100000:2.0:1787856665.551493:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436266752:12345-0@lo:501: Request processed in 68us (276us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787856665.551501:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787856665.552828:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436266368:0@lo:8: 00000100:00100000:1.0:1787856665.552890:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.553065:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436266752:0@lo:501: 10000000:01000000:3.0:1787856665.553100:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787856665.553110:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856665.553120:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856665.553203:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436266368 00000100:00100000:2.0:1787856665.553209:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436266368 00000100:00100000:2.0:1787856665.553425:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787856665.553432:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436266368:12345-0@lo:8: 00010000:00080000:2.0:1787856665.553460:0:8409:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1787856665.553490:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c3a11 00002000:00100000:2.0:1787856665.553503:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9064c688c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787856665.553507:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787856665.553510:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787856665.553580:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787856665.553619:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9064c5e7c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856665.553671:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1874703436266368:12345-0@lo:8: Request processed in 238us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.553679:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787856665.563200:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7062580 x1874703436266368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787856675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856665.563229:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787856665.563247:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787856665.563257:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787856665.563264:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787856665.563267:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c808a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787856665.563290:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787856665.563306:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436266368:0@lo:8: 00000004:00080000:3.0:1787856665.563499:0:9840:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787856665.563575:0:9840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199273356712ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787856665.563582:0:9840:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:3.0:1787856665.563660:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787856665.563667:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787856665.563765:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9832:x1874703436264832:12345-0@lo:700: Request processed in 53960us (61220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.563776:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787856665.564132:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ecb40 x1874703436264832/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856665.564144:0:9832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9832:1874703436264832:0@lo:700: 00000004:00080000:1.0:1787856665.582318:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787856665.592958:0:9841:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787856665.592992:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1874703436267008:0@lo:7: 00000100:00100000:0.0:1787856665.593063:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.593104:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.593125:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436266880:0@lo:13: 00000100:00100000:0.0:1787856665.593151:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.593184:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436267008 00000100:00100000:0.0:1787856665.593190:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436267008 00000100:00100000:0.0:1787856665.593264:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787856665.593273:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9841:x1874703436267008:12345-0@lo:7: 00000100:00100000:1.0:1787856665.595437:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436266880 00000100:00100000:1.0:1787856665.595449:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436266880 00000100:00100000:1.0:1787856665.595495:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787856665.595503:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7925a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436266880:12345-0@lo:13: 00002000:00000024:1.0:1787856665.595527:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1787856665.595679:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7925a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436266880:12345-0@lo:13: Request processed in 175us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856665.595688:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787856665.595734:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7927c00 x1874703436266880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856665.595755:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436266880:0@lo:13: 00000100:00080000:1.0:1787856665.597007:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1787856665.611173:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787856665.611182:0:8407:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787856665.615035:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9841:x1874703436267008:12345-0@lo:7: Request processed in 21753us (21963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856665.615049:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787856665.615412:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7927840 x1874703436267008/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856665.615427:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1874703436267008:0@lo:7: 00000004:00080000:1.0:1787856665.615443:0:9841:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787856665.615497:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1874703436267136:0@lo:5: 00000100:00100000:1.0:1787856665.615551:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856665.615592:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856665.616531:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436267136 00000100:00100000:3.0:1787856665.616537:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436267136 00000100:00100000:3.0:1787856665.616591:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787856665.616601:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9841:x1874703436267136:12345-0@lo:5: 00002000:00080000:3.0:1787856665.616627:0:8410:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787856665.616631:0:8410:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000004:00080000:0.0:1787856665.617087:0:9832:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787856665.617107:0:9832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7924b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9832:1874703436267392:0@lo:7: 00000100:00100000:0.0:1787856665.617154:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856665.617186:0:9832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ca683900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856665.617199:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c79270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436267264:0@lo:13: 00000100:00100000:0.0:1787856665.617259:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.617618:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9841:x1874703436267136:12345-0@lo:5: Request processed in 1018us (2066us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787856665.617628:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787856665.617645:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436267392 00000100:00100000:3.0:1787856665.617650:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436267392 00000100:00100000:3.0:1787856665.617669:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856665.617676:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7926d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9832:x1874703436267392:12345-0@lo:7: 00010000:00080000:1.0:1787856665.617958:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ecb40 x1874703436267136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856665.617976:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1874703436267136:0@lo:5: 00000004:00080000:1.0:1787856665.617986:0:9841:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787856665.618011:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1874703436267520:0@lo:700: 00000100:00100000:1.0:1787856665.618055:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856665.618077:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856665.618488:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436267264 00000100:00100000:1.0:1787856665.618493:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436267264 00000100:00100000:1.0:1787856665.618537:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787856665.618544:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436267264:12345-0@lo:13: 00002000:00000024:1.0:1787856665.618560:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1787856665.618598:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436267264:12345-0@lo:13: Request processed in 54us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856665.618605:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787856665.618671:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c79270c0 x1874703436267264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856665.618687:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c79270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436267264:0@lo:13: 00002000:00080000:3.0:1787856665.639891:0:8410:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787856665.639901:0:8410:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787856665.640008:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7926d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9832:x1874703436267392:12345-0@lo:7: Request processed in 22327us (22849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.640020:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787856665.640080:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7924b40 x1874703436267392/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.640095:0:9832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7924b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9832:1874703436267392:0@lo:7: 00000004:00080000:3.0:1787856665.640116:0:9832:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787856665.640153:0:9832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9832:1874703436267648:0@lo:5: 00000100:00100000:3.0:1787856665.640189:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.640252:0:9832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787856665.640512:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436267648 00000100:00100000:1.0:1787856665.640519:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436267648 00000100:00100000:1.0:1787856665.640563:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787856665.640572:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9832:x1874703436267648:12345-0@lo:5: 00002000:00080000:1.0:1787856665.640595:0:8409:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787856665.640639:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9832:x1874703436267648:12345-0@lo:5: Request processed in 68us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856665.640645:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856665.642924:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436267520 00000100:00100000:3.0:1787856665.642938:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436267520 00000100:00100000:3.0:1787856665.643019:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856665.643028:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9841:x1874703436267520:12345-0@lo:700: 00010000:00080000:2.0:1787856665.648146:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008e3480 x1874703436267648/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856665.648171:0:9832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9832:1874703436267648:0@lo:5: 00000004:00080000:2.0:1787856665.648187:0:9832:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787856665.648247:0:9832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9832:1874703436267776:0@lo:5: 00000100:00100000:2.0:1787856665.648324:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.648368:0:9832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856665.648387:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436267776 00000100:00100000:2.0:1787856665.648392:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436267776 00000100:00100000:2.0:1787856665.648436:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856665.648444:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7060f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9832:x1874703436267776:12345-0@lo:5: 00002000:00080000:2.0:1787856665.648481:0:8409:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1787856665.659760:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7060f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9832:x1874703436267776:12345-0@lo:5: Request processed in 11309us (11429us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787856665.659773:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787856665.661530:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7062940 x1874703436267776/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856665.661551:0:9832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9832:1874703436267776:0@lo:5: 00000004:00080000:2.0:1787856665.661567:0:9832:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787856665.661610:0:9832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7061680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9832:1874703436267904:0@lo:900: 00000100:00100000:2.0:1787856665.661661:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856665.661712:0:9832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427540 going to sleep for 11 seconds 00000001:00080000:0.0:1787856665.662269:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1787856665.662712:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436267904 00000100:00100000:3.0:1787856665.662721:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436267904 00000100:00100000:3.0:1787856665.662778:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856665.662788:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9832:x1874703436267904:12345-0@lo:900: 00000100:00100000:3.0:1787856665.662864:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9832:x1874703436267904:12345-0@lo:900: Request processed in 77us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856665.662872:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856665.663098:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9841:x1874703436267520:12345-0@lo:700: Request processed in 20070us (45042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856665.663107:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787856665.663146:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7061680 x1874703436267904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856665.663171:0:9832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7061680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9832:1874703436267904:0@lo:900: 00010000:00080000:3.0:1787856665.663362:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066007c0000 x1874703436267520/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856665.663372:0:9841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787856665.663384:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1874703436267520:0@lo:700: 00000004:02000040:3.0:1787856665.678118:0:9841:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1787856665.684298:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1874703436268032:0@lo:5: 00000100:00100000:3.0:1787856665.684530:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856665.684579:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787856665.684600:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436268032 00000100:00100000:3.0:1787856665.684607:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436268032 00000100:00100000:3.0:1787856665.684660:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787856665.684679:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9841:x1874703436268032:12345-0@lo:5: 00002000:00080000:3.0:1787856665.698169:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787856665.698192:0:8407:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1787856665.699702:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9841:x1874703436268032:12345-0@lo:5: Request processed in 15018us (15166us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787856665.699715:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787856665.701985:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008e0b40 x1874703436268032/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856681 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856665.702006:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1874703436268032:0@lo:5: 00000004:00080000:0.0:1787856665.702021:0:9841:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:0.0:1787856665.787256:0:9862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787856665.938234:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436268160:0@lo:13: 00000100:00100000:3.0:1787856665.938399:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856665.939629:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436268160 00000100:00100000:1.0:1787856665.939641:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436268160 00000100:00100000:1.0:1787856665.939705:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787856665.939716:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436268160:12345-0@lo:13: 00002000:00000024:1.0:1787856665.939749:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856665.939816:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436268160:12345-0@lo:13: Request processed in 101us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856665.939823:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787856665.939866:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c80ccf00 x1874703436268160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856665.939887:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436268160:0@lo:13: 00010000:00010000:3.0:1787856666.450281:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856666.450541:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856666.450564:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436268288:0@lo:13: 00000100:00100000:2.0:1787856666.450637:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856666.451655:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436268288 00000100:00100000:3.0:1787856666.451665:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436268288 00000100:00100000:3.0:1787856666.451731:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787856666.451741:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7061680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436268288:12345-0@lo:13: 00002000:00000024:3.0:1787856666.451767:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856666.451839:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7061680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436268288:12345-0@lo:13: Request processed in 99us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856666.451847:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787856666.451949:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70efc00 x1874703436268288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856666.451969:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436268288:0@lo:13: 00000020:00000004:2.0:1787856666.721204:0:9914:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856666.722069:0:9914:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787856666.962797:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856666.962828:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c79270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436268416:0@lo:41: 00000100:00100000:3.0:1787856666.962915:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856666.963150:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436268416 00000100:00100000:0.0:1787856666.963158:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436268416 00000100:00100000:0.0:1787856666.963307:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787856666.963317:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436268416:12345-0@lo:41: 00000004:00000024:0.0:1787856666.963355:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856666.963410:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436268416:12345-0@lo:41: Request processed in 95us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856666.963418:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787856666.963715:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c79270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436268416:0@lo:41: 00010000:00010000:0.0:1787856667.474085:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856667.480548:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856667.480593:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436268544:0@lo:41: 00000100:00100000:1.0:1787856667.480669:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856667.480997:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436268544 00000100:00100000:3.0:1787856667.481005:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436268544 00000100:00100000:3.0:1787856667.481057:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787856667.481067:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436268544:12345-0@lo:41: 00000004:00000024:3.0:1787856667.481101:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787856667.481159:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436268544:12345-0@lo:41: Request processed in 94us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856667.481182:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787856667.481273:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436268544:0@lo:41: 00000001:00080000:2.0:1787856667.670154:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787856667.670171:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787856668.497914:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856669.521408:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787856669.650086:0:10015:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787856669.650537:0:10015:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787856670.485849:0:10063:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856670.485859:0:10063:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787856670.545826:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856671.051281:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856671.051348:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426781312 00000100:00100000:2.0:1787856671.051360:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426781312 00000100:00100000:2.0:1787856671.051417:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:2.0:1787856671.051427:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1874703426781312:12345-192.168.202.6@tcp:250: 00010000:00080000:2.0:1787856671.051457:0:6491:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from f992ea53-5038-46c1-bdd9-a3b884b74351@192.168.202.6@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1787856671.051488:0:6491:0:(genops.c:1385:class_connect()) connect: client f992ea53-5038-46c1-bdd9-a3b884b74351, cookie 0xc25410d92a3c3a18 00000100:00080000:2.0:1787856671.051655:0:6491:0:(import.c:65:import_set_state_nolock()) ffff90660191e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856671.051757:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+5:2398:x1874703426781312:12345-192.168.202.6@tcp:250: Request processed in 329us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856671.051766:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:1.0:1787856671.057563:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436268672:0@lo:13: 00000100:00100000:1.0:1787856671.057644:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856671.058059:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436268672 00000100:00100000:3.0:1787856671.058079:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436268672 00000100:00100000:3.0:1787856671.058160:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787856671.058163:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c79252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436268800:0@lo:13: 00000100:00100000:3.0:1787856671.058169:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436268672:12345-0@lo:13: 00000100:00100000:0.0:1787856671.058196:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787856671.058442:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856671.058491:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436268672:12345-0@lo:13: Request processed in 323us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856671.058498:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856671.058515:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436268800 00000100:00100000:3.0:1787856671.058517:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436268800 00000100:00100000:3.0:1787856671.058534:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856671.058540:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436268800:12345-0@lo:13: 00002000:00000024:3.0:1787856671.058555:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856671.058660:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436268928:0@lo:13: 00000100:00100000:0.0:1787856671.058702:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.058735:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436269440:0@lo:400: 00000100:00100000:0.0:1787856671.058768:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.058786:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436269952:0@lo:400: 00000100:00100000:0.0:1787856671.058808:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.058830:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787856671.058836:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436269312:0@lo:400: 00000100:00080000:1.0:1787856671.058846:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856671.058860:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787856671.058861:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856671.058873:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7061e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436269056:0@lo:400: 00000100:00100000:0.0:1787856671.058877:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436269824:0@lo:400: 00000100:00100000:3.0:1787856671.058937:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436269440 00000100:00100000:3.0:1787856671.058941:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436269440 00000100:00100000:3.0:1787856671.059463:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436269952 00000100:00100000:3.0:1787856671.059469:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436269952 00000100:00100000:3.0:1787856671.059500:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787856671.059508:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436269440:12345-0@lo:400: 00000100:00100000:0.0:1787856671.071053:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.071140:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436270336:0@lo:400: 00000100:00100000:0.0:1787856671.071208:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.073593:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436269312 00000100:00100000:0.0:1787856671.073608:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436269312 00000100:00100000:0.0:1787856671.073692:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787856671.073703:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436269312:12345-0@lo:400: 00000100:00100000:0.0:1787856671.073799:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436269312:12345-0@lo:400: Request processed in 98us (14937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.073928:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787856671.073987:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436269312:0@lo:400: 00000100:00080000:0.0:1787856671.074033:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856671.074051:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436269184:0@lo:400: 00000100:00100000:0.0:1787856671.075351:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.075379:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436269696:0@lo:400: 00000100:00100000:0.0:1787856671.075407:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.075434:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436270208:0@lo:400: 00000100:00100000:0.0:1787856671.075877:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787856671.075909:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c80cc000 x1874703436268672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856671.075933:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436268672:0@lo:13: 00000100:00100000:0.0:1787856671.076000:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436270336 00000100:00100000:0.0:1787856671.076006:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436270336 00000100:00100000:0.0:1787856671.076066:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436269696 00000100:00100000:0.0:1787856671.076081:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436269696 00000100:00100000:0.0:1787856671.076102:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787856671.076110:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436270336:12345-0@lo:400: 00000100:00100000:0.0:1787856671.076163:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436270336:12345-0@lo:400: Request processed in 53us (4954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.076170:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787856671.076187:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856671.076194:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436269696:12345-0@lo:400: 00000100:00100000:0.0:1787856671.076264:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436269696:12345-0@lo:400: Request processed in 71us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.076270:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787856671.076287:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856671.076290:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856671.076309:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70630c0 x1874703436269696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856671.076339:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436269696:0@lo:400: 00010000:00080000:0.0:1787856671.076369:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7062d00 x1874703436270336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856671.076378:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787856671.076388:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436270336:0@lo:400: 00000100:00100000:0.0:1787856671.076422:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436269824 00000100:00100000:0.0:1787856671.076426:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436269824 00000100:00100000:0.0:1787856671.079425:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436269184 00000100:00100000:0.0:1787856671.079438:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436269184 00000100:00100000:1.0:1787856671.079723:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.079747:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436270208 00000100:00100000:0.0:1787856671.079764:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436270208 00000100:00100000:0.0:1787856671.079791:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787856671.079801:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436269952:12345-0@lo:400: 00000100:00100000:1.0:1787856671.079822:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436269568:0@lo:400: 00000100:00100000:1.0:1787856671.079869:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.079881:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436269952:12345-0@lo:400: Request processed in 82us (21073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.079888:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787856671.079893:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436269568 00000100:00100000:1.0:1787856671.079896:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436269568 00000100:00100000:0.0:1787856671.079905:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787856671.079910:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7925680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436269824:12345-0@lo:400: 00000100:00100000:1.0:1787856671.079923:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856671.079929:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436269568:12345-0@lo:400: 00000100:00100000:0.0:1787856671.079940:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7925680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436269824:12345-0@lo:400: Request processed in 31us (8896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.079946:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787856671.079960:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787856671.079966:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436269184:12345-0@lo:400: 00000100:00100000:1.0:1787856671.079973:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436269568:12345-0@lo:400: Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856671.079993:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787856671.079998:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436269184:12345-0@lo:400: Request processed in 33us (4650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.080012:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787856671.080023:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787856671.080028:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436270208:12345-0@lo:400: 00000100:00100000:1.0:1787856671.080030:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436269568:0@lo:400: 00000100:00100000:1.0:1787856671.080038:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436270080:0@lo:400: 00000100:00100000:1.0:1787856671.080058:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856671.080058:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436270208:12345-0@lo:400: Request processed in 30us (4182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.080064:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787856671.082187:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436270080 00000100:00100000:0.0:1787856671.082200:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436270080 00000100:00100000:0.0:1787856671.082279:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787856671.082288:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436270080:12345-0@lo:400: 00000100:00100000:0.0:1787856671.082387:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436270080:12345-0@lo:400: Request processed in 100us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.082393:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787856671.082431:0:8411:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787856671.082440:0:8411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:0.0:1787856671.083383:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856671.083390:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787856671.083432:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7063c00 x1874703436269184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856671.083446:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436269184:0@lo:400: 00010000:00080000:0.0:1787856671.083469:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70603c0 x1874703436270208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856671.083477:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436270208:0@lo:400: 00010000:00080000:0.0:1787856671.083514:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70612c0 x1874703436269824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856671.083543:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436269824:0@lo:400: 00010000:00080000:0.0:1787856671.083559:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7062580 x1874703436269952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856671.083567:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436269952:0@lo:400: 00000100:00100000:0.0:1787856671.083616:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436269056 00000100:00100000:0.0:1787856671.083622:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436269056 00000100:00100000:0.0:1787856671.083658:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787856671.083665:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436269056:12345-0@lo:400: 00000100:00100000:1.0:1787856671.087342:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856671.087388:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426781440 00000100:00100000:1.0:1787856671.087398:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426781440 00000100:00100000:1.0:1787856671.087441:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 181 00000100:00100000:1.0:1787856671.087450:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+5:6160:x1874703426781440:12345-192.168.202.6@tcp:101: 00010000:00010000:1.0:1787856671.087467:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856671.087485:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5dc1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856671.087513:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856671.087523:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856671.087532:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37d800, rc 0) 00000100:00100000:1.0:1787856671.087586:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+6:6160:x1874703426781440:12345-192.168.202.6@tcp:101: Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856671.087593:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 181 00010000:00080000:1.0:1787856671.087749:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7060780 x1874703436270080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856671.087764:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436270080:0@lo:400: 00000100:00100000:0.0:1787856671.088549:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436269056:12345-0@lo:400: Request processed in 4880us (8825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.088558:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787856671.088962:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436268800:12345-0@lo:13: Request processed in 30410us (30752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856671.088973:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787856671.088996:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436268928 00000100:00100000:2.0:1787856671.089010:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436268928 00000100:00100000:2.0:1787856671.089042:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856671.089049:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436268928:12345-0@lo:13: 00002000:00000024:2.0:1787856671.089080:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856671.089124:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436268928:12345-0@lo:13: Request processed in 76us (30421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856671.089130:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787856671.089165:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7060000 x1874703436268928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856671.089183:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436268928:0@lo:13: 00010000:00080000:0.0:1787856671.090067:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c79252c0 x1874703436268800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856671.090089:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787856671.090107:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c79252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436268800:0@lo:13: 00000100:00100000:1.0:1787856671.092185:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7061e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436269056:0@lo:400: 00000100:00100000:3.0:1787856671.095744:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436269440:12345-0@lo:400: Request processed in 36174us (36911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856671.095761:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787856671.098850:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7063480 x1874703436269440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856671.098870:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436269440:0@lo:400: 00000100:00100000:1.0:1787856671.109335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856671.111277:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426781568 00000100:00100000:3.0:1787856671.111296:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426781568 00000100:00100000:3.0:1787856671.111391:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 182 00000100:00100000:3.0:1787856671.111402:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+6:6160:x1874703426781568:12345-192.168.202.6@tcp:501: 00000100:00100000:3.0:1787856671.111544:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+6:6160:x1874703426781568:12345-192.168.202.6@tcp:501: Request processed in 144us (2218us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787856671.111552:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 182 00000100:00100000:1.0:1787856671.117977:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856671.118085:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426781696 00000100:00100000:0.0:1787856671.118096:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426781696 00000100:00100000:0.0:1787856671.118173:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 183 00000100:00100000:0.0:1787856671.118183:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+6:6160:x1874703426781696:12345-192.168.202.6@tcp:101: 00010000:00010000:0.0:1787856671.118201:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856671.118274:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5dc8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856671.118306:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856671.118332:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856671.118341:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff000, rc 0) 00000100:00100000:0.0:1787856671.118401:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+7:6160:x1874703426781696:12345-192.168.202.6@tcp:101: Request processed in 219us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.118408:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 183 00000100:00100000:1.0:1787856671.147315:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856671.147409:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426781824 00000100:00100000:0.0:1787856671.147422:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426781824 00000100:00100000:0.0:1787856671.147489:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 184 00000100:00100000:0.0:1787856671.147500:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+7:6160:x1874703426781824:12345-192.168.202.6@tcp:501: 00000100:00100000:0.0:1787856671.147676:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6160:x1874703426781824:12345-192.168.202.6@tcp:501: Request processed in 176us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.147684:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 184 00000100:00100000:1.0:1787856671.157142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856671.157420:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426781952 00000100:00100000:3.0:1787856671.157431:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426781952 00000100:00100000:3.0:1787856671.157656:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 185 00000100:00100000:3.0:1787856671.157668:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6160:x1874703426781952:12345-192.168.202.6@tcp:503: 00000100:00100000:3.0:1787856671.157846:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6160:x1874703426781952:12345-192.168.202.6@tcp:503: Request processed in 180us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856671.157854:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 185 00000100:00100000:1.0:1787856671.185439:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856671.185603:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426782080 00000100:00100000:0.0:1787856671.185614:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426782080 00000100:00100000:0.0:1787856671.185678:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 186 00000100:00100000:0.0:1787856671.185688:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6179:x1874703426782080:12345-192.168.202.6@tcp:502: 00000100:00100000:0.0:1787856671.185848:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6179:x1874703426782080:12345-192.168.202.6@tcp:502: Request processed in 160us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.185856:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 186 00000100:00100000:1.0:1787856671.284985:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856671.285111:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426782208 00000100:00100000:2.0:1787856671.285124:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426782208 00000100:00100000:2.0:1787856671.285191:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:2.0:1787856671.285202:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6179:x1874703426782208:12345-192.168.202.6@tcp:502: 00000100:00100000:2.0:1787856671.285440:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6179:x1874703426782208:12345-192.168.202.6@tcp:502: Request processed in 239us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856671.285449:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:1.0:1787856671.302097:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856671.302179:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426782336 00000100:00100000:3.0:1787856671.302189:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426782336 00000100:00100000:3.0:1787856671.302294:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:3.0:1787856671.302304:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6160:x1874703426782336:12345-192.168.202.6@tcp:101: 00010000:00010000:3.0:1787856671.302322:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856671.302342:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c9800/0xc25410d92a3c3a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5df9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856671.302373:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c9800/0xc25410d92a3c3a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5df9 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856671.302384:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c9800/0xc25410d92a3c3a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5df9 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856671.302394:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9800, rc 0) 00000100:00100000:3.0:1787856671.302474:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6160:x1874703426782336:12345-192.168.202.6@tcp:101: Request processed in 172us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856671.302481:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:1.0:1787856671.319135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856671.319274:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426782464 00000100:00100000:0.0:1787856671.319285:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426782464 00000100:00100000:0.0:1787856671.319340:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:0.0:1787856671.319349:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6160:x1874703426782464:12345-192.168.202.6@tcp:256: 20000000:01000000:0.0:1787856671.319395:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787856671.319412:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787856671.319416:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787856671.319420:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787856671.319424:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787856671.319427:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787856671.325571:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6160:x1874703426782464:12345-192.168.202.6@tcp:256: Request processed in 6207us (6431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.325588:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:1.0:1787856671.330718:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856671.330828:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426782592 00000100:00100000:2.0:1787856671.330846:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426782592 00000100:00100000:2.0:1787856671.330909:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:2.0:1787856671.330919:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6160:x1874703426782592:12345-192.168.202.6@tcp:101: 00010000:00010000:2.0:1787856671.330935:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856671.330967:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5e00 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856671.330997:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856671.331008:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856671.331017:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a400, rc 0) 00000100:00100000:2.0:1787856671.331078:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6160:x1874703426782592:12345-192.168.202.6@tcp:101: Request processed in 160us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856671.331085:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:1.0:1787856671.333908:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856671.334075:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426782720 00000100:00100000:0.0:1787856671.334086:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426782720 00000100:00100000:0.0:1787856671.334149:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00100000:0.0:1787856671.334159:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6160:x1874703426782720:12345-192.168.202.6@tcp:501: 00000100:00100000:0.0:1787856671.334376:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6160:x1874703426782720:12345-192.168.202.6@tcp:501: Request processed in 217us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.334384:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00100000:1.0:1787856671.338610:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856671.339013:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426782848 00000100:00100000:3.0:1787856671.339021:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426782848 00000100:00100000:3.0:1787856671.339069:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:3.0:1787856671.339079:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6160:x1874703426782848:12345-192.168.202.6@tcp:503: 00000100:00100000:3.0:1787856671.339268:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6160:x1874703426782848:12345-192.168.202.6@tcp:503: Request processed in 189us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856671.339276:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:1.0:1787856671.342569:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856671.342672:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426782976 00000100:00100000:2.0:1787856671.342682:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426782976 00000100:00100000:2.0:1787856671.342740:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 193 00000100:00100000:2.0:1787856671.342763:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6184:x1874703426782976:12345-192.168.202.6@tcp:502: 00000100:00100000:2.0:1787856671.342933:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6184:x1874703426782976:12345-192.168.202.6@tcp:502: Request processed in 184us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856671.342951:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 193 00000100:00100000:1.0:1787856671.348745:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856671.348855:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426783104 00000100:00100000:0.0:1787856671.348864:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426783104 00000100:00100000:0.0:1787856671.348963:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:0.0:1787856671.348973:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6184:x1874703426783104:12345-192.168.202.6@tcp:502: 00000100:00100000:0.0:1787856671.349130:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6184:x1874703426783104:12345-192.168.202.6@tcp:502: Request processed in 158us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856671.349138:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:1.0:1787856671.352735:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856671.352784:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856671.353053:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426783232 00000100:00100000:3.0:1787856671.353062:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426783232 00000100:00100000:3.0:1787856671.353104:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426783488 00000100:00100000:3.0:1787856671.353107:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426783488 00000100:00100000:3.0:1787856671.353133:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1787856671.353140:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1874703426783232:12345-192.168.202.6@tcp:38: 00010000:00080000:3.0:1787856671.353168:0:9124:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1787856671.353260:0:9124:0:(genops.c:1385:class_connect()) connect: client 898e91b3-529b-44bc-a821-726bff6c71d4, cookie 0xc25410d92a3c3a3b 00000004:00100000:3.0:1787856671.353285:0:9124:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1787856671.353494:0:9124:0:(import.c:65:import_set_state_nolock()) ffff9064c8088000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856671.353580:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:2398:x1874703426783232:12345-192.168.202.6@tcp:38: Request processed in 438us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856671.353588:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1787856671.353604:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1787856671.353608:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1874703426783488:12345-192.168.202.6@tcp:38: 00010000:00080000:3.0:1787856671.353621:0:9124:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from 898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1787856671.353654:0:9124:0:(genops.c:1385:class_connect()) connect: client 898e91b3-529b-44bc-a821-726bff6c71d4, cookie 0xc25410d92a3c3a42 00000004:00100000:3.0:1787856671.353664:0:9124:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1787856671.353801:0:9124:0:(import.c:65:import_set_state_nolock()) ffff9064c808b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856671.353825:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:2398:x1874703426783488:12345-192.168.202.6@tcp:38: Request processed in 216us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856671.353831:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00010000:00010000:3.0:1787856671.571008:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856671.571211:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856671.575609:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436270464:0@lo:13: 00000100:00100000:0.0:1787856671.575699:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856671.575959:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436270464 00000100:00100000:2.0:1787856671.575967:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436270464 00000100:00100000:2.0:1787856671.576020:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787856671.576029:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436270464:12345-0@lo:13: 00002000:00000024:2.0:1787856671.576054:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856671.576114:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436270464:12345-0@lo:13: Request processed in 86us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856671.576122:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787856671.576413:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70efc00 x1874703436270464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856671.576433:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436270464:0@lo:13: 00000100:00100000:2.0:1787856672.082921:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856672.082958:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436270592:0@lo:41: 00000100:00100000:2.0:1787856672.083034:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856672.083369:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436270592 00000100:00100000:0.0:1787856672.083378:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436270592 00000100:00100000:0.0:1787856672.083433:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787856672.083443:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436270592:12345-0@lo:41: 00000004:00000024:0.0:1787856672.083476:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856672.083536:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436270592:12345-0@lo:41: Request processed in 95us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856672.083543:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787856672.085478:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436270592:0@lo:41: 00000100:00100000:1.0:1787856672.112366:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856672.112414:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856672.112532:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426783744 00000100:00100000:0.0:1787856672.112551:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426783744 00000100:00100000:3.0:1787856672.112665:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426783360 00000100:00100000:3.0:1787856672.112675:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426783360 00000100:00100000:3.0:1787856672.112732:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1787856672.112743:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:6160:x1874703426783744:12345-192.168.202.6@tcp:41: 00000100:00100000:0.0:1787856672.112789:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000004:00000024:3.0:1787856672.112801:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787856672.112810:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+7:0:x1874703426783360:12345-192.168.202.6@tcp:41: 00000004:00000024:0.0:1787856672.112849:0:9124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787856672.112896:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:6160:x1874703426783744:12345-192.168.202.6@tcp:41: Request processed in 151us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856672.112905:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1787856672.112931:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:0:x1874703426783360:12345-192.168.202.6@tcp:41: Request processed in 127us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856672.112941:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1787856672.113047:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856672.113157:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426783616 00000100:00100000:2.0:1787856672.113163:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426783616 00000100:00100000:2.0:1787856672.113213:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1787856672.113266:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:0:x1874703426783616:12345-192.168.202.6@tcp:41: 00000004:00000024:2.0:1787856672.113282:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787856672.113324:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:0:x1874703426783616:12345-192.168.202.6@tcp:41: Request processed in 60us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856672.113331:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00080000:1.0:1787856672.113459:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856672.113467:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856672.115820:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856672.116279:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426783872 00000100:00100000:0.0:1787856672.116288:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426783872 00000100:00100000:0.0:1787856672.116347:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1787856672.116356:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:6160:x1874703426783872:12345-192.168.202.6@tcp:40: 00000100:00100000:0.0:1787856672.116464:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:6160:x1874703426783872:12345-192.168.202.6@tcp:40: Request processed in 109us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856672.116472:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:1.0:1787856672.125056:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856672.125117:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856672.125151:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856672.125198:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856672.125345:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426784000 00000100:00100000:2.0:1787856672.125360:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426784000 00000100:00100000:3.0:1787856672.125375:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426784128 00000100:00100000:3.0:1787856672.125386:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426784128 00000100:00100000:2.0:1787856672.125423:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426784256 00000100:00100000:2.0:1787856672.125429:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426784256 00000100:00100000:2.0:1787856672.125460:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1787856672.125473:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 195 00000100:00100000:2.0:1787856672.125474:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874703426784000:12345-192.168.202.6@tcp:8: 00000100:00100000:3.0:1787856672.125491:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426784128:12345-192.168.202.6@tcp:400: 00010000:00080000:2.0:1787856672.125516:0:8410:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787856672.125554:0:8410:0:(genops.c:1385:class_connect()) connect: client 898e91b3-529b-44bc-a821-726bff6c71d4, cookie 0xc25410d92a3c3a49 00002000:00100000:2.0:1787856672.125568:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 898e91b3-529b-44bc-a821-726bff6c71d4/ffff90660191f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787856672.125580:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:3.0:1787856672.125713:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426784128:12345-192.168.202.6@tcp:400: Request processed in 223us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856672.125724:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 195 00002000:00080000:2.0:1787856672.125810:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787856672.125844:0:8410:0:(import.c:65:import_set_state_nolock()) ffff90660191b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856672.125962:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426784384 00000100:00100000:0.0:1787856672.125967:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426784384 00000100:00100000:0.0:1787856672.126021:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1787856672.126033:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:898e91b3-529b-44bc-a821-726bff6c71d4+6:6160:x1874703426784384:12345-192.168.202.6@tcp:900: 00000100:00100000:0.0:1787856672.128406:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:898e91b3-529b-44bc-a821-726bff6c71d4+6:6160:x1874703426784384:12345-192.168.202.6@tcp:900: Request processed in 2368us (3278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856672.128422:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1787856672.128520:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2398:x1874703426784000:12345-192.168.202.6@tcp:8: Request processed in 3048us (3365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856672.128530:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:2.0:1787856672.128568:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:2.0:1787856672.128574:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874703426784256:12345-192.168.202.6@tcp:8: 00010000:00080000:2.0:1787856672.128606:0:8410:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787856672.128635:0:8410:0:(genops.c:1385:class_connect()) connect: client 898e91b3-529b-44bc-a821-726bff6c71d4, cookie 0xc25410d92a3c3a50 00002000:00100000:2.0:1787856672.128647:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 898e91b3-529b-44bc-a821-726bff6c71d4/ffff906601919800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787856672.128659:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787856672.128935:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787856672.129035:0:8410:0:(import.c:65:import_set_state_nolock()) ffff906601918800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856672.129207:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2398:x1874703426784256:12345-192.168.202.6@tcp:8: Request processed in 630us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856672.129256:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1787856672.133014:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856672.133152:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426784512 00000100:00100000:2.0:1787856672.133166:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426784512 00000100:00100000:2.0:1787856672.133334:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1787856672.133348:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:6160:x1874703426784512:12345-192.168.202.6@tcp:33: 00000004:00080000:3.0:1787856672.167030:0:6499:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33484us 00000004:00200000:2.0:1787856672.179199:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787856672.179367:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:6160:x1874703426784512:12345-192.168.202.6@tcp:33: Request processed in 46017us (46362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856672.179380:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:1.0:1787856672.390503:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856672.390844:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426784640 00000100:00100000:2.0:1787856672.390857:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426784640 00000100:00100000:2.0:1787856672.390924:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1787856672.390934:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:6202:x1874703426784640:12345-192.168.202.6@tcp:101: 00010000:00010000:2.0:1787856672.390959:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856672.390985:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3a57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5e31 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856672.391071:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3a5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856672.391084:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856672.391098:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856672.391140:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787856672.391143:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856672.391156:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856672.391189:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3a57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e31 expref: 8 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856672.391276:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3a5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e31 expref: 7 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856672.391286:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c793e300) 00010000:00010000:2.0:1787856672.391289:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856672.391292:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a600, rc 0) 00000100:00100000:2.0:1787856672.391354:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:6202:x1874703426784640:12345-192.168.202.6@tcp:101: Request processed in 421us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856672.391361:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00010000:00010000:3.0:1787856672.593490:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856672.593647:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856672.593681:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7061e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436270720:0@lo:41: 00000100:00100000:1.0:1787856672.593787:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856672.594344:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436270720 00000100:00100000:2.0:1787856672.594356:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436270720 00000100:00100000:2.0:1787856672.594441:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787856672.594450:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436270720:12345-0@lo:41: 00000004:00000024:2.0:1787856672.594483:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787856672.594577:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436270720:12345-0@lo:41: Request processed in 128us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856672.594584:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787856672.594706:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7061e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436270720:0@lo:41: 00010000:00010000:0.0:1787856673.619537:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856674.641771:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856674.661151:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856674.661311:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426784768 00000100:00100000:3.0:1787856674.661328:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426784768 00000100:00100000:3.0:1787856674.661443:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1787856674.661459:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+7:6254:x1874703426784768:12345-192.168.202.6@tcp:41: 00000004:00000024:3.0:1787856674.661513:0:9124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787856674.661620:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+7:6254:x1874703426784768:12345-192.168.202.6@tcp:41: Request processed in 167us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856674.661629:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00080000:1.0:1787856674.661792:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856674.666523:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856674.666655:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426784896 00000100:00100000:2.0:1787856674.666667:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426784896 00000100:00100000:2.0:1787856674.666750:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1787856674.666761:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:6254:x1874703426784896:12345-192.168.202.6@tcp:41: 00000004:00000024:2.0:1787856674.666806:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787856674.666889:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:6254:x1874703426784896:12345-192.168.202.6@tcp:41: Request processed in 131us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856674.666895:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00080000:1.0:1787856674.667094:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856674.675926:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856674.676102:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426785024 00000100:00100000:1.0:1787856674.676115:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426785024 00000100:00100000:1.0:1787856674.676278:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1787856674.676294:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:898e91b3-529b-44bc-a821-726bff6c71d4+6:6254:x1874703426785024:12345-192.168.202.6@tcp:13: 00000100:00080000:0.0:1787856674.676295:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787856674.676346:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856674.676437:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:898e91b3-529b-44bc-a821-726bff6c71d4+6:6254:x1874703426785024:12345-192.168.202.6@tcp:13: Request processed in 149us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856674.676446:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:0.0:1787856674.680392:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856674.680668:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426785152 00000100:00100000:2.0:1787856674.680687:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426785152 00000100:00100000:2.0:1787856674.680790:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:2.0:1787856674.680807:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:898e91b3-529b-44bc-a821-726bff6c71d4+6:6254:x1874703426785152:12345-192.168.202.6@tcp:13: 00000100:00080000:0.0:1787856674.680808:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787856674.680902:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856674.681301:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:898e91b3-529b-44bc-a821-726bff6c71d4+6:6254:x1874703426785152:12345-192.168.202.6@tcp:13: Request processed in 500us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856674.681311:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00010000:00010000:3.0:1787856675.670910:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856676.177431:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436270848:0@lo:13: 00000100:00100000:0.0:1787856676.177529:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856676.177627:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436270848 00000100:00100000:0.0:1787856676.177637:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436270848 00000100:00100000:0.0:1787856676.177703:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787856676.177714:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436270848:12345-0@lo:13: 00002000:00000024:0.0:1787856676.177742:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856676.177799:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436270848:12345-0@lo:13: Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856676.177807:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787856676.177834:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856676.177872:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b840 x1874703436270848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856676.177894:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436270848:0@lo:13: 00000100:00100000:0.0:1787856676.178042:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436270976:0@lo:13: 00000100:00100000:0.0:1787856676.178071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.178145:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436270976 00000100:00100000:1.0:1787856676.178150:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436270976 00000100:00100000:1.0:1787856676.178189:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787856676.178207:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436270976:12345-0@lo:13: 00002000:00000024:1.0:1787856676.178243:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856676.178280:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436270976:12345-0@lo:13: Request processed in 85us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.178288:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787856676.178343:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787856676.178363:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c80ccf00 x1874703436270976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856676.178389:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436270976:0@lo:13: 00000100:00100000:0.0:1787856676.179303:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436271104:0@lo:13: 00000100:00100000:0.0:1787856676.179353:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856676.179418:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436271104 00000100:00100000:0.0:1787856676.179423:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436271104 00000100:00100000:0.0:1787856676.179470:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787856676.179478:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436271104:12345-0@lo:13: 00002000:00000024:0.0:1787856676.179495:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856676.179532:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436271104:12345-0@lo:13: Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856676.179538:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787856676.179557:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856676.179582:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d692c0 x1874703436271104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856676.179599:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436271104:0@lo:13: 00000100:00100000:1.0:1787856676.183491:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436271232:0@lo:400: 00000100:00100000:1.0:1787856676.183594:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.183646:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436271744:0@lo:400: 00000100:00100000:1.0:1787856676.183680:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.183714:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436272256:0@lo:400: 00000100:00100000:1.0:1787856676.183762:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.183793:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787856676.183799:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436271616:0@lo:400: 00000100:00100000:1.0:1787856676.183823:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.183841:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436272128:0@lo:400: 00000100:00100000:1.0:1787856676.183881:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.183928:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436271232 00000100:00100000:1.0:1787856676.183937:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436271232 00000100:00100000:1.0:1787856676.183995:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787856676.184005:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436271232:12345-0@lo:400: 00000100:00100000:1.0:1787856676.184063:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436271232:12345-0@lo:400: Request processed in 59us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.184071:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787856676.184110:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436271744 00000100:00100000:1.0:1787856676.184114:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436271744 00000100:00100000:1.0:1787856676.184138:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787856676.184144:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436271744:12345-0@lo:400: 00000100:00100000:1.0:1787856676.184179:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436271744:12345-0@lo:400: Request processed in 36us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.184186:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787856676.184257:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436272256 00000100:00100000:1.0:1787856676.184261:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436272256 00000100:00100000:1.0:1787856676.184300:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436271616 00000100:00100000:1.0:1787856676.184304:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436271616 00000100:00100000:1.0:1787856676.184320:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436272128 00000100:00100000:1.0:1787856676.184322:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436272128 00000100:00100000:1.0:1787856676.184339:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787856676.184355:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436272256:12345-0@lo:400: 00000100:00100000:1.0:1787856676.184389:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436272256:12345-0@lo:400: Request processed in 36us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.184395:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787856676.184407:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787856676.184413:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436271616:12345-0@lo:400: 00000100:00100000:1.0:1787856676.184439:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436271616:12345-0@lo:400: Request processed in 27us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.184445:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787856676.184456:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787856676.184461:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436272128:12345-0@lo:400: 00000100:00100000:1.0:1787856676.184501:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436272128:12345-0@lo:400: Request processed in 40us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.184508:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787856676.184571:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436271616:0@lo:400: 00010000:00080000:1.0:1787856676.184587:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008d9680 x1874703436272128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856676.184598:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436272128:0@lo:400: 00000100:00100000:1.0:1787856676.184607:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436271232:0@lo:400: 00000100:00100000:1.0:1787856676.184616:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436271744:0@lo:400: 00000100:00100000:1.0:1787856676.184624:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436272256:0@lo:400: 00000100:00080000:1.0:1787856676.184659:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856676.184665:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856676.184678:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436271488:0@lo:400: 00000100:00100000:1.0:1787856676.184714:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.184734:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436272000:0@lo:400: 00000100:00100000:1.0:1787856676.184754:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.184774:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787856676.184780:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436271360:0@lo:400: 00000100:00100000:1.0:1787856676.184800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.184815:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436271872:0@lo:400: 00000100:00100000:1.0:1787856676.184838:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.184856:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436272384:0@lo:400: 00000100:00100000:1.0:1787856676.184881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856676.184903:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436271488 00000100:00100000:1.0:1787856676.184906:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436271488 00000100:00100000:1.0:1787856676.184930:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787856676.184936:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436271488:12345-0@lo:400: 00000100:00100000:1.0:1787856676.184970:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436271488:12345-0@lo:400: Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.184976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787856676.184990:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436272000 00000100:00100000:1.0:1787856676.184994:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436272000 00000100:00100000:1.0:1787856676.185015:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436271360 00000100:00100000:1.0:1787856676.185018:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436271360 00000100:00100000:1.0:1787856676.185028:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436272384 00000100:00100000:1.0:1787856676.185030:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436272384 00000100:00100000:1.0:1787856676.185044:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787856676.185049:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436272000:12345-0@lo:400: 00000100:00100000:1.0:1787856676.185077:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436272000:12345-0@lo:400: Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.185093:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787856676.185106:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856676.185112:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436271360:12345-0@lo:400: 00000100:00100000:1.0:1787856676.185141:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436271360:12345-0@lo:400: Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.185147:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856676.185157:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787856676.185163:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436272384:12345-0@lo:400: 00000100:00100000:1.0:1787856676.185188:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436272384:12345-0@lo:400: Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.185206:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787856676.185250:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436271872 00000100:00100000:1.0:1787856676.185254:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436271872 00000100:00100000:1.0:1787856676.185285:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787856676.185293:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436271872:12345-0@lo:400: 00000100:00100000:1.0:1787856676.185324:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436271872:12345-0@lo:400: Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856676.185330:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787856676.185354:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856676.185362:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856676.185364:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856676.185383:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436271360:0@lo:400: 00010000:00080000:1.0:1787856676.185394:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008da940 x1874703436271872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856676.185403:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436271872:0@lo:400: 00010000:00080000:1.0:1787856676.185422:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008d92c0 x1874703436272384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856676.185430:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436272384:0@lo:400: 00000100:00100000:1.0:1787856676.185438:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436271488:0@lo:400: 00000100:00100000:1.0:1787856676.185449:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436272000:0@lo:400: 00000001:00100000:3.0:1787856676.197187:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00010000:00010000:0.0:1787856676.690055:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856676.693348:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856676.693377:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436272512:0@lo:13: 00000100:00100000:0.0:1787856676.693465:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856676.693637:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436272512 00000100:00100000:2.0:1787856676.693645:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436272512 00000100:00100000:2.0:1787856676.693701:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787856676.693710:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436272512:12345-0@lo:13: 00002000:00000024:2.0:1787856676.693752:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856676.693807:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436272512:12345-0@lo:13: Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856676.693814:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787856676.694449:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008df480 x1874703436272512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856676.694480:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436272512:0@lo:13: 00000100:00100000:3.0:1787856677.201777:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436272640:0@lo:41: 00000100:00100000:3.0:1787856677.201856:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856677.201979:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436272640 00000100:00100000:2.0:1787856677.201988:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436272640 00000100:00100000:2.0:1787856677.202041:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787856677.202050:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436272640:12345-0@lo:41: 00000004:00000024:2.0:1787856677.202082:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787856677.202143:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436272640:12345-0@lo:41: Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856677.202151:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787856677.202302:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436272640:0@lo:41: 00000001:00100000:2.0:1787856677.204617:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000001:00100000:2.0:1787856677.206651:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000100:00100000:3.0:1787856677.344883:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856677.344936:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856677.344956:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856677.344975:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856677.344999:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856677.345029:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426785280 00000100:00100000:3.0:1787856677.345039:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426785280 00000100:00100000:3.0:1787856677.345091:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:3.0:1787856677.345101:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426785280:12345-192.168.202.6@tcp:400: 00000100:00100000:3.0:1787856677.345202:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426785280:12345-192.168.202.6@tcp:400: Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856677.345241:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:3.0:1787856677.345275:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426785408 00000100:00100000:3.0:1787856677.345280:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426785408 00000100:00100000:3.0:1787856677.345319:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426785536 00000100:00100000:3.0:1787856677.345322:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426785536 00000100:00100000:3.0:1787856677.345343:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:3.0:1787856677.345349:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426785408:12345-192.168.202.6@tcp:400: 00000100:00100000:3.0:1787856677.345380:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426785408:12345-192.168.202.6@tcp:400: Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856677.345386:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:3.0:1787856677.345567:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1787856677.345578:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426785536:12345-192.168.202.6@tcp:400: 00000100:00100000:3.0:1787856677.345606:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426785536:12345-192.168.202.6@tcp:400: Request processed in 32us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856677.352063:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1787856677.352108:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426785792 00000100:00100000:3.0:1787856677.352117:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426785792 00000100:00100000:3.0:1787856677.352294:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426785664 00000100:00100000:3.0:1787856677.352299:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426785664 00000100:00100000:2.0:1787856677.355032:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1787856677.355109:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426785792:12345-192.168.202.6@tcp:400: 00000100:00100000:0.0:1787856677.355235:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426785792:12345-192.168.202.6@tcp:400: Request processed in 172us (10239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856677.355244:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1787856677.355272:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:0.0:1787856677.355289:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426785664:12345-192.168.202.6@tcp:400: 00000100:00100000:0.0:1787856677.355318:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426785664:12345-192.168.202.6@tcp:400: Request processed in 31us (10318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856677.355324:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00080000:3.0:1787856677.355785:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856677.355791:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856677.355794:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856677.355797:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787856677.602736:0:10162:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787856677.739389:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436272768:0@lo:41: 00000100:00100000:1.0:1787856677.739469:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856677.739553:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436272768 00000100:00100000:1.0:1787856677.739560:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436272768 00000100:00100000:1.0:1787856677.739606:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787856677.739614:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436272768:12345-0@lo:41: 00000004:00000024:1.0:1787856677.739646:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787856677.739688:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436272768:12345-0@lo:41: Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856677.739696:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787856677.739741:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436272768:0@lo:41: 00010000:00010000:3.0:1787856677.747811:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787856678.232782:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00010000:00010000:3.0:1787856678.802018:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856679.830064:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856680.849354:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856681.298028:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856681.298055:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436272896:0@lo:13: 00000100:00100000:0.0:1787856681.298125:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.298234:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436272896 00000100:00100000:0.0:1787856681.298241:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436272896 00000100:00100000:0.0:1787856681.298294:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787856681.298304:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436272896:12345-0@lo:13: 00002000:00000024:0.0:1787856681.298333:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856681.298375:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436272896:12345-0@lo:13: Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856681.298381:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787856681.298402:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856681.298430:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b480 x1874703436272896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856681.298446:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436272896:0@lo:13: 00000100:00100000:1.0:1787856681.298796:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856681.298807:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436273024:0@lo:13: 00000100:00100000:1.0:1787856681.298839:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856681.298870:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436273024 00000100:00100000:1.0:1787856681.298873:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436273024 00000100:00100000:1.0:1787856681.298919:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787856681.298926:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436273024:12345-0@lo:13: 00002000:00000024:1.0:1787856681.298942:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856681.298974:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436273024:12345-0@lo:13: Request processed in 49us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856681.298980:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787856681.298996:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787856681.299013:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008d92c0 x1874703436273024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856681.299026:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436273024:0@lo:13: 00000100:00100000:2.0:1787856681.299278:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436273408:0@lo:400: 00000100:00100000:2.0:1787856681.299313:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856681.299334:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436273920:0@lo:400: 00000100:00100000:2.0:1787856681.299359:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856681.299376:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436274432:0@lo:400: 00000100:00100000:2.0:1787856681.299400:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856681.299421:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787856681.299425:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436273536:0@lo:400: 00000100:00100000:2.0:1787856681.299443:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856681.299468:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436274048:0@lo:400: 00000100:00100000:2.0:1787856681.299493:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856681.299516:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436273408 00000100:00100000:2.0:1787856681.299519:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436273408 00000100:00100000:2.0:1787856681.299544:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787856681.299773:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436273408:12345-0@lo:400: 00000100:00100000:2.0:1787856681.299813:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436273408:12345-0@lo:400: Request processed in 44us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856681.299819:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787856681.299837:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436273920 00000100:00100000:2.0:1787856681.299840:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436273920 00000100:00100000:2.0:1787856681.299866:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436273536 00000100:00100000:2.0:1787856681.299869:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436273536 00000100:00100000:2.0:1787856681.299883:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436274048 00000100:00100000:2.0:1787856681.299886:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436274048 00000100:00100000:2.0:1787856681.299899:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787856681.299904:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436273920:12345-0@lo:400: 00000100:00100000:2.0:1787856681.299930:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436273920:12345-0@lo:400: Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856681.299936:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787856681.299945:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787856681.299950:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436273536:12345-0@lo:400: 00000100:00100000:2.0:1787856681.299971:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436273536:12345-0@lo:400: Request processed in 22us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856681.299977:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787856681.299987:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787856681.299992:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436274048:12345-0@lo:400: 00000100:00100000:2.0:1787856681.300016:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436274048:12345-0@lo:400: Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856681.300031:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787856681.300048:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436274432 00000100:00100000:2.0:1787856681.300051:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436274432 00000100:00100000:2.0:1787856681.300077:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787856681.300084:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7beda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436274432:12345-0@lo:400: 00000100:00100000:2.0:1787856681.300112:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7beda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436274432:12345-0@lo:400: Request processed in 29us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856681.300117:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787856681.300398:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856681.300403:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856681.300405:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856681.300428:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436273536:0@lo:400: 00010000:00080000:3.0:1787856681.300442:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7062580 x1874703436274048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856681.300463:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436274048:0@lo:400: 00000100:00100000:3.0:1787856681.300474:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436273408:0@lo:400: 00000100:00100000:3.0:1787856681.300484:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436273920:0@lo:400: 00010000:00080000:3.0:1787856681.300493:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d275b480 x1874703436274432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856681.300501:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436274432:0@lo:400: 00000100:00100000:3.0:1787856681.300520:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856681.300526:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436274560:0@lo:13: 00000100:00100000:3.0:1787856681.300563:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856681.300853:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436273280:0@lo:400: 00000100:00100000:1.0:1787856681.300883:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856681.300913:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436273792:0@lo:400: 00000100:00100000:1.0:1787856681.300936:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856681.300951:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7061e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436274304:0@lo:400: 00000100:00100000:1.0:1787856681.300971:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856681.300991:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787856681.300997:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436273152:0@lo:400: 00000100:00100000:1.0:1787856681.301021:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856681.301045:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436273664:0@lo:400: 00000100:00100000:1.0:1787856681.301067:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856681.301084:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436274176:0@lo:400: 00000100:00100000:1.0:1787856681.301103:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856681.301141:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436273152 00000100:00100000:1.0:1787856681.301154:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436273152 00000100:00100000:1.0:1787856681.301187:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787856681.301203:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436273152:12345-0@lo:400: 00000100:00100000:1.0:1787856681.301254:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436273152:12345-0@lo:400: Request processed in 52us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856681.301260:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787856681.301287:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436273280 00000100:00100000:1.0:1787856681.301290:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436273280 00000100:00100000:1.0:1787856681.301309:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436274304 00000100:00100000:1.0:1787856681.301312:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436274304 00000100:00100000:1.0:1787856681.301333:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436274176 00000100:00100000:1.0:1787856681.301335:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436274176 00000100:00100000:1.0:1787856681.301349:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787856681.301354:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436273280:12345-0@lo:400: 00000100:00100000:1.0:1787856681.301382:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436273280:12345-0@lo:400: Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856681.301388:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787856681.301398:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787856681.301403:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436274304:12345-0@lo:400: 00000100:00100000:1.0:1787856681.301426:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436274304:12345-0@lo:400: Request processed in 23us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856681.301431:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787856681.301441:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787856681.301653:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436273792 00000100:00100000:2.0:1787856681.301658:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436273792 00000100:00100000:1.0:1787856681.301737:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436274176:12345-0@lo:400: 00000100:00100000:1.0:1787856681.301768:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436274176:12345-0@lo:400: Request processed in 322us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856681.301775:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787856681.301800:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856681.301804:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856681.301832:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436273152:0@lo:400: 00000100:00100000:1.0:1787856681.301843:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436274176:0@lo:400: 00000100:00100000:1.0:1787856681.301851:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436273280:0@lo:400: 00010000:00080000:1.0:1787856681.301860:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7061e00 x1874703436274304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856681.301870:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7061e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436274304:0@lo:400: 00000100:00100000:1.0:1787856681.301906:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436273664 00000100:00100000:1.0:1787856681.301909:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436273664 00000100:00100000:1.0:1787856681.301933:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787856681.301940:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436273664:12345-0@lo:400: 00000100:00100000:1.0:1787856681.301975:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436273664:12345-0@lo:400: Request processed in 36us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856681.301981:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787856681.302006:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436273664:0@lo:400: 00000100:00100000:2.0:1787856681.302385:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787856681.302393:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436273792:12345-0@lo:400: 00000100:00100000:2.0:1787856681.302433:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436273792:12345-0@lo:400: Request processed in 41us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856681.302439:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787856681.302584:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436274560 00000100:00100000:0.0:1787856681.302589:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436274560 00000100:00100000:0.0:1787856681.302616:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856681.302622:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436274560:12345-0@lo:13: 00002000:00000024:0.0:1787856681.302636:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856681.302686:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436274560:12345-0@lo:13: Request processed in 64us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856681.302698:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787856681.302735:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5cb40 x1874703436274560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856681.302750:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436274560:0@lo:13: 00010000:00080000:0.0:1787856681.302793:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70603c0 x1874703436273792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856681.302802:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436273792:0@lo:400: 00000100:00080000:1.0:1787856681.303009:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856681.809985:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436274688:0@lo:13: 00000100:00100000:0.0:1787856681.810070:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856681.810180:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436274688 00000100:00100000:2.0:1787856681.810189:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436274688 00000100:00100000:2.0:1787856681.810268:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787856681.810278:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436274688:12345-0@lo:13: 00002000:00000024:2.0:1787856681.810300:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856681.815463:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436274688:12345-0@lo:13: Request processed in 5175us (5382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856681.815482:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787856681.818302:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5d680 x1874703436274688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856681.818329:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436274688:0@lo:13: 00010000:00010000:3.0:1787856681.873343:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787856681.985267:0:10310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe524eab90 20000000:00000080:0.0:1787856681.985286:0:10310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff906601946000 uarg=0000000000000000 20000000:01000000:0.0:1787856681.985332:0:10310:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787856681.985334:0:10310:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787856681.985337:0:10310:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787856681.985342:0:10310:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787856681.985347:0:10310:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787856681.985416:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787856681.985419:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787856681.986628:0:10311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1787856681.988677:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1787856681.988715:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1787856681.988730:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1787856681.989031:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787856681.989035:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787856681.990083:0:10312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1787856681.990703:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1787856681.990734:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1787856681.990999:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1787856681.991014:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787856681.991016:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787856681.991521:0:10313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1787856681.991696:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1787856681.991718:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1787856681.992008:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1787856681.992023:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787856681.992026:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787856681.992571:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1787856681.992731:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1787856681.992995:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1787856681.993014:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1787856681.993027:0:10310:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787856681.993029:0:10310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787856681.994002:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787856681.994617:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787856681.994644:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787856681.994660:0:10310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1787856681.994680:0:10310:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787856681.994700:0:10310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.994719:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.994728:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.994734:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.994995:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995002:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c397e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995010:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c399a expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995017:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995024:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995030:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995050:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995059:0:10310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995066:0:10310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995108:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995204:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 9 pid: 6491 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.995324:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436274816:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856681.995550:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995560:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 9 pid: 6488 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.995568:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436274944:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856681.995601:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995609:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.995630:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275072:0@lo:104: 00000100:00100000:2.0:1787856681.995687:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787856681.995733:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995755:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 23 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.995763:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b28000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275200:0@lo:104: 00000100:00100000:2.0:1787856681.995794:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787856681.995832:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.995839:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 23 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.995846:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275328:0@lo:104: 00000100:00100000:0.0:1787856681.995950:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436275072 00000100:00100000:0.0:1787856681.995958:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436275072 00000100:00100000:0.0:1787856681.995992:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436275200 00000100:00100000:0.0:1787856681.995995:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436275200 00000100:00100000:0.0:1787856681.996020:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787856681.996028:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:10310:x1874703436275072:12345-0@lo:104: 00010000:00010000:0.0:1787856681.996039:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996089:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787856681.996095:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:10310:x1874703436275072:12345-0@lo:104: Request processed in 67us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856681.996102:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787856681.996120:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856681.996147:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:10310:x1874703436275200:12345-0@lo:104: 00010000:00010000:0.0:1787856681.996155:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996191:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787856681.996197:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:10310:x1874703436275200:12345-0@lo:104: Request processed in 59us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856681.996203:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787856681.996238:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856681.996243:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996251:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b400 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787856681.996255:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996263:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856681.996280:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856681.996286:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787856681.996320:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996327:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856681.996344:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996351:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076b400/0xc25410d92a3c3a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3a0a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996492:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856681.996496:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996502:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076ba00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787856681.996505:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996512:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856681.996518:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856681.996523:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787856681.996555:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996562:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856681.996576:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996583:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076ba00/0xc25410d92a3c39e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996592:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856681.996594:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856681.996595:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856681.996608:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436275456:0@lo:103: 00000100:00100000:0.0:1787856681.996641:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.996675:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436275584:0@lo:103: 00000100:00100000:0.0:1787856681.996698:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.996728:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436275456 00000100:00100000:0.0:1787856681.996732:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436275456 00010000:00010000:0.0:1787856681.996750:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 24 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856681.996769:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436275584 00000100:00100000:0.0:1787856681.996772:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436275584 00010000:00010000:0.0:1787856681.996780:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 25 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856681.996793:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787856681.996799:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+25:3624:x1874703436275456:12345-0@lo:103: 00010000:00010000:0.0:1787856681.996808:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856681.996819:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 25 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996829:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 25 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.996844:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856681.997056:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787856681.997090:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c399a expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.997100:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c399a expref: 25 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.997109:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275712:0@lo:104: 00000100:00100000:1.0:1787856681.997240:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436275328 00000100:00100000:1.0:1787856681.997244:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436275328 00000100:00100000:1.0:1787856681.997265:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787856681.997272:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:10310:x1874703436275328:12345-0@lo:104: 00010000:00010000:1.0:1787856681.997281:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856681.997662:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+25:3624:x1874703436275456:12345-0@lo:103: Request processed in 861us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856681.997671:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787856681.997710:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856681.997716:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436275584:12345-0@lo:103: 00010000:00010000:0.0:1787856681.997723:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856681.997728:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 24 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.997747:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 24 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.997760:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856681.997791:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436275584:12345-0@lo:103: Request processed in 75us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856681.997797:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856681.998029:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436275584:0@lo:103: 00000100:00100000:0.0:1787856681.998053:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436275456:0@lo:103: 00010000:00010000:1.0:1787856681.998130:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787856681.998137:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:10310:x1874703436275328:12345-0@lo:104: Request processed in 865us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856681.998152:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787856681.998279:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856681.998286:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.998308:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076bc00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787856681.998312:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.998321:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856681.998328:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856681.998334:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787856681.998372:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.998378:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856681.998390:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.998396:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076bc00/0xc25410d92a3c39c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.998407:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856681.998408:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856681.998410:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856681.998419:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436275840:0@lo:103: 00000100:00100000:0.0:1787856681.998447:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.998481:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436275840 00000100:00100000:0.0:1787856681.998485:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436275840 00010000:00010000:0.0:1787856681.998499:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 24 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856681.998522:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787856681.998528:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436275840:12345-0@lo:103: 00010000:00010000:0.0:1787856681.998536:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856681.998540:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 24 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.998548:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 24 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856681.998558:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856681.998581:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436275840:12345-0@lo:103: Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856681.998586:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787856681.998608:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436275840:0@lo:103: 00000100:00100000:2.0:1787856681.999039:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787856681.999083:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c397e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.999104:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c397e expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.999114:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b29a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275968:0@lo:104: 00010000:00010000:2.0:1787856681.999161:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.999169:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.999177:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436276096:0@lo:104: 00010000:00010000:2.0:1787856681.999197:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.999204:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.999211:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b28b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436276224:0@lo:104: 00010000:00010000:2.0:1787856681.999354:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.999372:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 23 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.999380:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436276352:0@lo:104: 00010000:00010000:2.0:1787856681.999416:0:10310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856681.999433:0:10310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 23 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.999441:0:10310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436276480:0@lo:104: 00000100:00100000:2.0:1787856681.999457:0:10310:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a540 going to sleep for 11 seconds 00010000:00010000:2.0:1787856681.999472:0:10310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c8000/0xc25410d92a3c3a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3a03 expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.999483:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275072:0@lo:104: 00010000:00010000:2.0:1787856681.999493:0:10310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076b800/0xc25410d92a3c39e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c39e0 expref: 22 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.999501:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b28000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275200:0@lo:104: 00010000:00010000:2.0:1787856681.999509:0:10310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076a000/0xc25410d92a3c39cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c39c4 expref: 21 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856681.999516:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275328:0@lo:104: 00000100:00100000:0.0:1787856681.999633:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787856681.999650:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.999672:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.999680:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.999687:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.999695:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856681.999701:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436275712 00000100:00100000:0.0:1787856681.999704:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436275712 00000100:00100000:0.0:1787856681.999726:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436275968 00000100:00100000:0.0:1787856681.999728:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436275968 00000100:00100000:0.0:1787856681.999735:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436276096 00000100:00100000:0.0:1787856681.999737:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436276096 00000100:00100000:1.0:1787856681.999969:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436276224 00000100:00100000:1.0:1787856681.999974:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436276224 00000100:00100000:1.0:1787856681.999989:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436276352 00000100:00100000:1.0:1787856681.999991:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436276352 00000100:00100000:1.0:1787856682.000001:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436276480 00000100:00100000:1.0:1787856682.000003:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436276480 00000100:00100000:1.0:1787856682.000014:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787856682.000021:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fda71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+7:10310:x1874703436275712:12345-0@lo:104: 00010000:00010000:1.0:1787856682.000031:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000086:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787856682.000097:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fda71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+7:10310:x1874703436275712:12345-0@lo:104: Request processed in 76us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.000103:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787856682.000159:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787856682.000165:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+6:10310:x1874703436275968:12345-0@lo:104: 00010000:00010000:1.0:1787856682.000173:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000205:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787856682.000210:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+6:10310:x1874703436275968:12345-0@lo:104: Request processed in 45us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.000236:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787856682.000250:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856682.000256:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:10310:x1874703436276224:12345-0@lo:104: 00010000:00010000:1.0:1787856682.000263:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000290:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787856682.000294:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:10310:x1874703436276224:12345-0@lo:104: Request processed in 39us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.000299:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856682.000311:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787856682.000315:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:10310:x1874703436276352:12345-0@lo:104: 00010000:00010000:1.0:1787856682.000322:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000345:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787856682.000367:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:10310:x1874703436276352:12345-0@lo:104: Request processed in 40us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.000374:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787856682.000389:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787856682.000395:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:10310:x1874703436276480:12345-0@lo:104: 00010000:00010000:1.0:1787856682.000402:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000429:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787856682.000434:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:10310:x1874703436276480:12345-0@lo:104: Request processed in 40us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.000440:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787856682.000456:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787856682.000461:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000468:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856682.000471:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000479:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856682.000486:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856682.000492:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856682.000532:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000548:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856682.000567:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000573:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c399a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c39a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000585:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787856682.000588:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000593:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37ca00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856682.000595:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000601:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856682.000606:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856682.000611:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856682.000623:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000628:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856682.000632:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000637:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065cd37ca00/0xc25410d92a3c397e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3985 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000652:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787856682.000655:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000659:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37d600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856682.000661:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000667:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856682.000672:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856682.000677:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856682.000688:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000694:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856682.000707:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000713:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065cd37d600/0xc25410d92a3c3962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3969 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000722:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856682.000724:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000750:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff800 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856682.000753:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000760:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856682.000765:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856682.000777:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856682.000792:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000798:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856682.000803:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000810:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff800/0xc25410d92a3c3923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c392a expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000828:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856682.000831:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.000838:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856682.000841:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.001315:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856682.001321:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856682.001326:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856682.001422:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.001429:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856682.001434:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.001440:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff600/0xc25410d92a3c38f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3900 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.001451:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856682.001453:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856682.001455:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856682.001471:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436276608:0@lo:103: 00000100:00100000:1.0:1787856682.001515:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856682.001545:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436277120:0@lo:103: 00000100:00100000:1.0:1787856682.001561:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856682.001577:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856682.001581:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436276736:0@lo:103: 00000100:00100000:1.0:1787856682.001598:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856682.001626:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436276608 00000100:00100000:1.0:1787856682.001638:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436276608 00010000:00010000:1.0:1787856682.001661:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c399a expref: 21 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.001683:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436277120 00000100:00100000:1.0:1787856682.001686:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436277120 00010000:00010000:1.0:1787856682.001696:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 22 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.001704:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436276736 00000100:00100000:1.0:1787856682.001706:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436276736 00010000:00010000:1.0:1787856682.001714:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c397e expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.001724:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787856682.001730:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436276608:12345-0@lo:103: 00010000:00010000:1.0:1787856682.002327:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856682.002335:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c399a expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.002346:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c399a expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.002447:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856682.002489:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436276608:12345-0@lo:103: Request processed in 758us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.002498:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787856682.002519:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787856682.002527:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+22:3623:x1874703436277120:12345-0@lo:103: 00010000:00010000:1.0:1787856682.002537:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856682.002550:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 22 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.002559:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 22 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.002569:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856682.002593:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+22:3623:x1874703436277120:12345-0@lo:103: Request processed in 68us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.002599:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787856682.002611:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856682.002616:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+21:3623:x1874703436276736:12345-0@lo:103: 00010000:00010000:1.0:1787856682.002624:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856682.002628:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c397e expref: 21 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.002637:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c397e expref: 21 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.002645:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856682.002669:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+21:3623:x1874703436276736:12345-0@lo:103: Request processed in 53us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.002675:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856682.002718:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436276992:0@lo:103: 00000100:00100000:1.0:1787856682.002757:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856682.003024:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856682.003031:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:10310:x1874703436276096:12345-0@lo:104: 00010000:00010000:0.0:1787856682.003052:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.003102:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856682.003109:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436276864:0@lo:103: 00010000:00010000:2.0:1787856682.003303:0:10310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c39a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c399a expref: 20 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856682.003319:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275712:0@lo:104: 00010000:00010000:2.0:1787856682.003334:0:10310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5fec00/0xc25410d92a3c3985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c397e expref: 19 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856682.003342:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b29a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436275968:0@lo:104: 00000100:00100000:2.0:1787856682.003354:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b28b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436276224:0@lo:104: 00000100:00100000:2.0:1787856682.003380:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436276352:0@lo:104: 00010000:00010000:2.0:1787856682.003401:0:10310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076b600/0xc25410d92a3c3900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c38f9 expref: 18 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856682.003411:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436276480:0@lo:104: 00000100:00100000:1.0:1787856682.003999:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856682.004063:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436276736:0@lo:103: 00000100:00100000:1.0:1787856682.004084:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436276608:0@lo:103: 00000100:00100000:1.0:1787856682.004091:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436277120:0@lo:103: 00010000:00010000:1.0:1787856682.004130:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856682.004151:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436276992 00000100:00100000:1.0:1787856682.004157:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436276992 00010000:00010000:1.0:1787856682.004178:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 18 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.004199:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436276864 00000100:00100000:1.0:1787856682.004202:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436276864 00010000:00010000:1.0:1787856682.004213:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 19 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.004245:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787856682.004252:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+19:3626:x1874703436276992:12345-0@lo:103: 00010000:00010000:1.0:1787856682.004261:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856682.004266:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 19 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.004276:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 19 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.004290:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c8e00/0xc25410d92a3c392a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3923 expref: 19 pid: 6488 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.004302:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856682.004335:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+18:3626:x1874703436276992:12345-0@lo:103: Request processed in 84us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.004341:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787856682.004373:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787856682.004380:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+17:3626:x1874703436276864:12345-0@lo:103: 00010000:00010000:1.0:1787856682.004407:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856682.004412:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 17 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.004419:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 17 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.004429:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3962 expref: 17 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.004438:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856682.004462:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+16:3626:x1874703436276864:12345-0@lo:103: Request processed in 83us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.004467:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787856682.004518:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436276864:0@lo:103: 00000100:00100000:1.0:1787856682.004526:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436276992:0@lo:103: 00010000:00010000:2.0:1787856682.005321:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856682.005471:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787856682.005480:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:10310:x1874703436276096:12345-0@lo:104: Request processed in 2449us (5805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856682.005489:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787856682.005672:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436276096:0@lo:104: 00010000:00010000:1.0:1787856682.005755:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856682.005763:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.005783:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37d000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856682.005788:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.005797:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856682.006057:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856682.006065:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856682.006115:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.006132:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856682.006163:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.006171:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065cd37d000/0xc25410d92a3c3970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3977 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.006188:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856682.006190:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856682.006192:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856682.006200:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856682.006212:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436277248:0@lo:103: 00000100:00100000:1.0:1787856682.006280:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856682.006320:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436277248 00000100:00100000:1.0:1787856682.006325:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436277248 00010000:00010000:1.0:1787856682.006349:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 16 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.006595:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787856682.006604:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+16:3623:x1874703436277248:12345-0@lo:103: 00010000:00010000:1.0:1787856682.006616:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856682.006621:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 16 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.006638:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 16 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.006652:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3970 expref: 16 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.006665:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856682.006698:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+15:3623:x1874703436277248:12345-0@lo:103: Request processed in 96us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.006704:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787856682.006732:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436277248:0@lo:103: 00000100:00100000:3.0:1787856682.013341:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436274816:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856682.013360:0:10310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10310:1874703436274944:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856682.013418:0:10310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.015034:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856682.015102:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426785920 00000100:00100000:0.0:1787856682.015110:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426785920 00010000:00010000:0.0:1787856682.015158:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 10 pid: 6491 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856682.015202:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1787856682.015213:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2402:x1874703426785920:12345-192.168.202.6@tcp:103: 00010000:00010000:0.0:1787856682.015251:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856682.015257:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 10 pid: 6491 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856682.015270:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 10 pid: 6491 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856682.015289:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c3a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc8 expref: 10 pid: 6491 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856682.015308:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856682.015360:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f992ea53-5038-46c1-bdd9-a3b884b74351+9:2402:x1874703426785920:12345-192.168.202.6@tcp:103: Request processed in 149us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856682.015369:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1787856682.021012:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856682.021108:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426786048 00000100:00100000:1.0:1787856682.021117:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426786048 00010000:00010000:1.0:1787856682.021164:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 9 pid: 6488 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856682.021211:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1787856682.021244:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f992ea53-5038-46c1-bdd9-a3b884b74351+9:2402:x1874703426786048:12345-192.168.202.6@tcp:103: 00010000:00010000:1.0:1787856682.021260:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856682.021266:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 9 pid: 6488 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021280:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 9 pid: 6488 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021300:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5dc1 expref: 9 pid: 6488 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021332:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021340:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021368:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021376:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021382:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021389:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021395:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856682.021399:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021407:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021424:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.021435:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856682.021488:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f992ea53-5038-46c1-bdd9-a3b884b74351+8:2402:x1874703426786048:12345-192.168.202.6@tcp:103: Request processed in 246us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.021502:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00010000:00010000:0.0:1787856682.023094:0:10310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856682.023108:0:10310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856682.023114:0:10310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076b200/0xc25410d92a3c3a65 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856682.173992:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856682.174091:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426786176 00000100:00100000:1.0:1787856682.174102:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426786176 00000100:00100000:1.0:1787856682.174183:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 199 00000100:00100000:1.0:1787856682.174194:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+8:6174:x1874703426786176:12345-192.168.202.6@tcp:101: 00010000:00010000:1.0:1787856682.174211:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856682.174263:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065cd37d600/0xc25410d92a3c3a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5e38 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.174293:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37d600/0xc25410d92a3c3a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e38 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.174304:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065cd37d600/0xc25410d92a3c3a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e38 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856682.174312:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37d600, rc 0) 00000100:00100000:1.0:1787856682.174585:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6174:x1874703426786176:12345-192.168.202.6@tcp:101: Request processed in 391us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.174592:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 199 00000100:00100000:3.0:1787856682.205211:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856682.205282:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426786304 00000100:00100000:3.0:1787856682.205293:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426786304 00000100:00100000:3.0:1787856682.205357:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:3.0:1787856682.205367:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6174:x1874703426786304:12345-192.168.202.6@tcp:501: 00000100:00100000:3.0:1787856682.205512:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6174:x1874703426786304:12345-192.168.202.6@tcp:501: Request processed in 146us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856682.205520:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:0.0:1787856682.220058:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856682.220093:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426786432 00000100:00100000:0.0:1787856682.220102:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426786432 00000100:00100000:0.0:1787856682.220236:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 201 00000100:00100000:0.0:1787856682.220246:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6174:x1874703426786432:12345-192.168.202.6@tcp:503: 00000100:00100000:0.0:1787856682.220379:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6174:x1874703426786432:12345-192.168.202.6@tcp:503: Request processed in 135us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856682.220387:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 201 00000100:00100000:0.0:1787856682.242398:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856682.242436:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426786560 00000100:00100000:0.0:1787856682.242446:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426786560 00000100:00100000:0.0:1787856682.242493:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:0.0:1787856682.242502:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6647:x1874703426786560:12345-192.168.202.6@tcp:502: 00000100:00100000:0.0:1787856682.242647:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6647:x1874703426786560:12345-192.168.202.6@tcp:502: Request processed in 145us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856682.242655:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:1.0:1787856682.257420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856682.258260:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426786688 00000100:00100000:2.0:1787856682.258272:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426786688 00000100:00100000:2.0:1787856682.258329:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 203 00000100:00100000:2.0:1787856682.258339:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6647:x1874703426786688:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856682.258518:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6647:x1874703426786688:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 179us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856682.258527:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 203 00000100:00100000:0.0:1787856682.266376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856682.266615:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426786816 00000100:00100000:3.0:1787856682.266625:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426786816 00000100:00100000:3.0:1787856682.266686:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:3.0:1787856682.266697:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6174:x1874703426786816:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856682.266716:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856682.266932:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c3a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5e3f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856682.266969:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c3a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e3f expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856682.266981:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c3a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e3f expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856682.266990:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274bc00, rc 0) 00000100:00100000:3.0:1787856682.267051:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6174:x1874703426786816:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 355us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856682.267057:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:2.0:1787856682.277544:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856682.277599:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426786944 00000100:00100000:1.0:1787856682.277608:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426786944 00000100:00100000:1.0:1787856682.277684:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:1.0:1787856682.277692:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6174:x1874703426786944:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856682.277818:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6174:x1874703426786944:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 125us (281us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787856682.277826:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:2.0:1787856682.322971:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856682.322997:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436277376:0@lo:41: 00000100:00100000:2.0:1787856682.323071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856682.323529:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436277376 00000100:00100000:0.0:1787856682.323537:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436277376 00000100:00100000:0.0:1787856682.323603:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787856682.323612:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436277376:12345-0@lo:41: 00000004:00000024:0.0:1787856682.323647:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856682.323702:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436277376:12345-0@lo:41: Request processed in 91us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856682.323708:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787856682.324206:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436277376:0@lo:41: 00000100:00100000:2.0:1787856682.465659:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856682.465754:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856682.465780:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856682.465825:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856682.465882:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426787072 00000100:00100000:3.0:1787856682.465892:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426787072 00000100:00100000:3.0:1787856682.465944:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:3.0:1787856682.465953:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426787072:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856682.466046:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426787072:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856682.466054:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:0.0:1787856682.466891:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426787456 00000100:00100000:0.0:1787856682.466899:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426787456 00000100:00100000:0.0:1787856682.466964:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1787856682.466972:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426787456:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856682.467031:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426787456:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 59us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856682.467038:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00080000:3.0:1787856682.467846:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856682.476189:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856682.477545:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426787584 00000100:00100000:2.0:1787856682.477555:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426787584 00000100:00100000:2.0:1787856682.479007:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:2.0:1787856682.479022:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426787584:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856682.479712:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426787584:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 692us (3627us total) trans 0 rc 0/0 00000100:00080000:0.0:1787856682.479793:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856682.480420:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:1.0:1787856682.482549:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426787200 00000100:00100000:1.0:1787856682.482562:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426787200 00000100:00100000:1.0:1787856682.482647:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426787328 00000100:00100000:1.0:1787856682.482651:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426787328 00000100:00100000:1.0:1787856682.482686:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:1.0:1787856682.482698:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426787200:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856682.482778:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426787200:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (17128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.482785:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:1.0:1787856682.482803:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1787856682.482809:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426787328:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856682.482834:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426787328:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (17010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856682.482841:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00080000:0.0:1787856682.483041:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856682.483045:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856682.833662:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856682.833690:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436277504:0@lo:41: 00000100:00100000:0.0:1787856682.833760:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856682.833971:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436277504 00000100:00100000:2.0:1787856682.833979:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436277504 00000100:00100000:2.0:1787856682.834026:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787856682.834033:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436277504:12345-0@lo:41: 00000004:00000024:2.0:1787856682.834059:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787856682.834109:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436277504:12345-0@lo:41: Request processed in 76us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856682.834124:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787856682.834437:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436277504:0@lo:41: 00010000:00010000:1.0:1787856682.897504:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787856683.025680:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787856683.025688:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065fe85b800 from 48 10000000:01000000:0.0:1787856683.025694:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787856683.025752:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.025764:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.025804:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856683.025829:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436277632:0@lo:101: 00000100:00100000:0.0:1787856683.025911:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856683.026062:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890780 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.027079:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436277632 00000100:00100000:1.0:1787856683.027089:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436277632 00000100:00100000:1.0:1787856683.031124:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787856683.031162:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+15:6493:x1874703436277632:12345-0@lo:101: 00010000:00010000:1.0:1787856683.031181:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856683.031211:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3a81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3a7a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.031268:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3a7a expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.031281:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3a7a expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.031307:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37c200, rc 0) 00000100:00100000:1.0:1787856683.031374:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436277632:12345-0@lo:101: Request processed in 226us (5463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.031381:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787856683.032120:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436277632:0@lo:101: 00010000:00010000:0.0:1787856683.032153:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.032163:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856683.032271:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436277760:0@lo:501: 00000100:00100000:0.0:1787856683.032307:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856683.032350:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890780 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.032495:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436277760 00000100:00100000:1.0:1787856683.032502:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436277760 00000100:00100000:1.0:1787856683.032541:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787856683.032549:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436277760:12345-0@lo:501: 00000100:00100000:1.0:1787856683.032911:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436277760:12345-0@lo:501: Request processed in 362us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.032918:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787856683.035091:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436277760:0@lo:501: 00000100:00100000:2.0:1787856683.035178:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436277888:0@lo:503: 00000100:00100000:2.0:1787856683.035493:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.035527:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.035640:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436277888 00000100:00100000:0.0:1787856683.035647:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436277888 00000100:00100000:0.0:1787856683.035700:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787856683.035709:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436277888:12345-0@lo:503: 00000100:00100000:0.0:1787856683.036249:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436277888:12345-0@lo:503: Request processed in 540us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.036258:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787856683.045012:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436277888:0@lo:503: 00000100:00100000:2.0:1787856683.047064:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10327:1874703436278016:0@lo:502: 00000100:00100000:2.0:1787856683.047185:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.047429:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.052300:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436278016 00000100:00100000:3.0:1787856683.052316:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436278016 00000100:00100000:3.0:1787856683.052449:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787856683.052461:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:10327:x1874703436278016:12345-0@lo:502: 00000100:00100000:3.0:1787856683.052675:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+16:10327:x1874703436278016:12345-0@lo:502: Request processed in 216us (5490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.052683:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787856683.052815:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10327:1874703436278016:0@lo:502: 00000100:00100000:2.0:1787856683.052886:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10327:1874703436278144:0@lo:502: 00000100:00100000:2.0:1787856683.052931:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856683.063349:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436278144 00000100:00100000:1.0:1787856683.063363:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436278144 00000100:00100000:1.0:1787856683.063417:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787856683.063428:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:10327:x1874703436278144:12345-0@lo:502: 00000100:00100000:1.0:1787856683.063583:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:10327:x1874703436278144:12345-0@lo:502: Request processed in 156us (10650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.063591:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787856683.063779:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.063816:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10327:1874703436278144:0@lo:502: 00000040:00080000:0.0:1787856683.063863:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787856683.064596:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787856683.064630:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787856683.064648:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.064659:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856683.064668:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787856683.064671:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787856683.064674:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787856683.064706:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.064713:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.064921:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856683.064940:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436278272:0@lo:101: 00000100:00100000:2.0:1787856683.064997:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.065032:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.065258:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436278272 00000100:00100000:1.0:1787856683.065265:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436278272 00000100:00100000:1.0:1787856683.065299:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787856683.065306:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+16:6493:x1874703436278272:12345-0@lo:101: 00010000:00010000:1.0:1787856683.065318:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856683.065331:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065cd37c000/0xc25410d92a3c3a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3a88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.065366:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37c000/0xc25410d92a3c3a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3a88 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.065375:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065cd37c000/0xc25410d92a3c3a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3a88 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.065384:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37c000, rc 0) 00000100:00100000:1.0:1787856683.065429:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436278272:12345-0@lo:101: Request processed in 122us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.065435:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787856683.065653:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436278272:0@lo:101: 00010000:00010000:2.0:1787856683.065667:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.065676:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856683.066618:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436278400:0@lo:501: 00000100:00100000:2.0:1787856683.066678:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.066706:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.067417:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436278400 00000100:00100000:1.0:1787856683.067423:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436278400 00000100:00100000:1.0:1787856683.067470:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787856683.067479:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436278400:12345-0@lo:501: 00000100:00100000:1.0:1787856683.067615:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436278400:12345-0@lo:501: Request processed in 136us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.067622:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787856683.067967:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436278400:0@lo:501: 00000100:00100000:2.0:1787856683.068017:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436278528:0@lo:503: 00000100:00100000:2.0:1787856683.068059:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.068089:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.068584:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436278528 00000100:00100000:1.0:1787856683.068589:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436278528 00000100:00100000:1.0:1787856683.068658:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787856683.068666:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436278528:12345-0@lo:503: 00000100:00100000:1.0:1787856683.068782:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436278528:12345-0@lo:503: Request processed in 116us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.068789:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787856683.069155:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436278528:0@lo:503: 00000100:00100000:2.0:1787856683.080329:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10328:1874703436278656:0@lo:502: 00000100:00100000:2.0:1787856683.080414:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.080454:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.081789:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436278656 00000100:00100000:0.0:1787856683.081799:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436278656 00000100:00100000:0.0:1787856683.081846:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787856683.081855:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:10328:x1874703436278656:12345-0@lo:502: 00000100:00100000:0.0:1787856683.082023:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:10328:x1874703436278656:12345-0@lo:502: Request processed in 169us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.082033:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787856683.082078:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10328:1874703436278656:0@lo:502: 00000020:01000000:2.0:1787856683.082127:0:10328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856683.082149:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856683.082151:0:10328:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787856683.082156:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787856683.082186:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10328:1874703436278784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.082258:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.082288:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.083162:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436278784 00000100:00100000:0.0:1787856683.083168:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436278784 00000100:00100000:0.0:1787856683.083207:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787856683.083229:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:10328:x1874703436278784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856683.083343:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:10328:x1874703436278784:12345-0@lo:502:llog_process_th.0 Request processed in 128us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.083350:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787856683.083430:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10328:1874703436278784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856683.083455:0:10328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856683.083461:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856683.083464:0:10328:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787856683.083468:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787856683.084924:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787856683.084959:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787856683.085085:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.085099:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856683.085110:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787856683.085113:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065fe6d5000 from 48 10000000:01000000:0.0:1787856683.085188:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787856683.085341:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.085350:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.085372:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856683.085394:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436278912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.085453:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856683.085569:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.085613:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436278912 00000100:00100000:1.0:1787856683.085620:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436278912 00000100:00100000:1.0:1787856683.085700:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787856683.085717:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+17:6493:x1874703436278912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856683.085729:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856683.085740:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065cd37c400/0xc25410d92a3c3a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3a96 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.085764:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37c400/0xc25410d92a3c3a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3a96 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.085774:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065cd37c400/0xc25410d92a3c3a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3a96 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.085782:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37c400, rc 0) 00000100:00100000:1.0:1787856683.085876:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436278912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.085884:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787856683.086461:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436278912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856683.086480:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.086497:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856683.086564:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.086596:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.086664:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.086696:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436279040 00000100:00100000:1.0:1787856683.086701:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436279040 00000100:00100000:1.0:1787856683.086763:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787856683.086770:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436279040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856683.086890:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436279040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.086898:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787856683.087030:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.087056:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.087094:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.087122:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.087506:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436279168 00000100:00100000:1.0:1787856683.087510:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436279168 00000100:00100000:1.0:1787856683.087534:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787856683.087540:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436279168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856683.087617:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436279168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.087631:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787856683.088336:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856683.088752:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10329:1874703436279296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856683.088802:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856683.088928:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6bc4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.088970:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436279296 00000100:00100000:0.0:1787856683.089419:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436279296 00000100:00100000:0.0:1787856683.089511:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787856683.089520:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:10329:x1874703436279296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856683.089636:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+18:10329:x1874703436279296:12345-0@lo:502:llog_process_th.0 Request processed in 116us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.089644:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787856683.089719:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10329:1874703436279296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856683.089766:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10329:1874703436279424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856683.089800:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856683.089884:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c52539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.089986:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436279424 00000100:00100000:3.0:1787856683.089991:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436279424 00000100:00100000:3.0:1787856683.090019:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787856683.090025:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+18:10329:x1874703436279424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856683.090100:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+18:10329:x1874703436279424:12345-0@lo:502:llog_process_th.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.090107:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787856683.090243:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10329:1874703436279424:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787856683.090263:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787856683.090550:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787856683.090578:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787856683.090588:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.090598:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856683.090619:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787856683.090622:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787856683.090624:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787856683.090650:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.090658:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.090667:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856683.090681:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.090713:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856683.090746:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.090795:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436279552 00000100:00100000:1.0:1787856683.090799:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436279552 00000100:00100000:1.0:1787856683.090831:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787856683.090910:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+18:6493:x1874703436279552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856683.090922:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856683.090936:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065cd37ca00/0xc25410d92a3c3aab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3aa4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.090956:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37ca00/0xc25410d92a3c3aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3aa4 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.090967:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065cd37ca00/0xc25410d92a3c3aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3aa4 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.090975:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37ca00, rc 0) 00000100:00100000:1.0:1787856683.091671:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436279552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 831us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.091687:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787856683.094473:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856683.094506:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.094518:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856683.094635:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.094694:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.094748:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.094805:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436279680 00000100:00100000:1.0:1787856683.094812:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436279680 00000100:00100000:1.0:1787856683.094866:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787856683.094875:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436279680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856683.095018:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436279680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.095026:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787856683.095533:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.095568:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.095614:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.095650:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.095748:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436279808 00000100:00100000:0.0:1787856683.095753:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436279808 00000100:00100000:0.0:1787856683.095790:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787856683.095798:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436279808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.095901:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436279808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.095909:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787856683.095932:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436279808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.096579:0:10330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10330:1874703436279936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.096620:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.096651:0:10330:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.096690:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436279936 00000100:00100000:3.0:1787856683.096695:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436279936 00000100:00100000:3.0:1787856683.096730:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787856683.096738:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:10330:x1874703436279936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856683.096884:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:10330:x1874703436279936:12345-0@lo:502:llog_process_th.0 Request processed in 146us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.096891:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787856683.102052:0:10330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10330:1874703436279936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856683.102108:0:10330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856683.102121:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856683.102123:0:10330:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787856683.102138:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787856683.102181:0:10330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10330:1874703436280064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.102278:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.102331:0:10330:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.102484:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436280064 00000100:00100000:3.0:1787856683.102492:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436280064 00000100:00100000:3.0:1787856683.102537:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787856683.102547:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+19:10330:x1874703436280064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856683.102663:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+19:10330:x1874703436280064:12345-0@lo:502:llog_process_th.0 Request processed in 117us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.102677:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787856683.103636:0:10330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10330:1874703436280064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856683.103666:0:10330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856683.103673:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856683.103676:0:10330:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787856683.103679:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1787856683.103861:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787856683.103886:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787856683.103897:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.103908:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856683.103918:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787856683.103921:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065f7199800 from 48 10000000:01000000:3.0:1787856683.103924:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787856683.103952:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.103960:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.103969:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856683.104106:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.104170:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856683.104197:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.104402:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436280192 00000100:00100000:0.0:1787856683.104408:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436280192 00000100:00100000:0.0:1787856683.104450:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787856683.104459:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+19:6493:x1874703436280192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856683.104470:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856683.104491:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3ab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3ab2 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.104514:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3ab2 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.104524:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3ab2 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.104533:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ffa00, rc 0) 00000100:00100000:0.0:1787856683.104573:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436280192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.104580:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787856683.107078:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856683.107107:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.107136:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856683.107243:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.107311:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.107345:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.108007:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436280320 00000100:00100000:3.0:1787856683.108013:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436280320 00000100:00100000:3.0:1787856683.108054:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787856683.108062:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436280320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.108209:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436280320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.108246:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787856683.109317:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.109373:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.109430:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.109470:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.109949:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436280448 00000100:00100000:3.0:1787856683.109954:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436280448 00000100:00100000:3.0:1787856683.110194:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787856683.110204:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436280448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.110343:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436280448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.110350:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787856683.110440:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.110636:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10331:1874703436280576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.110671:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.116816:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.117253:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436280576 00000100:00100000:0.0:1787856683.117264:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436280576 00000100:00100000:0.0:1787856683.117319:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787856683.117329:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:10331:x1874703436280576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856683.117492:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:10331:x1874703436280576:12345-0@lo:502:llog_process_th.0 Request processed in 164us (6819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.117500:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787856683.117630:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10331:1874703436280576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.117690:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10331:1874703436280704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.117745:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.117767:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.117922:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436280704 00000100:00100000:0.0:1787856683.117927:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436280704 00000100:00100000:0.0:1787856683.117947:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787856683.117953:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:10331:x1874703436280704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856683.118280:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:10331:x1874703436280704:12345-0@lo:502:llog_process_th.0 Request processed in 327us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.118288:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787856683.118442:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10331:1874703436280704:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787856683.118465:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787856683.118641:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787856683.118663:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787856683.118674:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.118685:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856683.118695:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787856683.118698:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1787856683.118701:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787856683.118738:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.118747:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.118757:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856683.118773:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.118813:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856683.118834:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.119009:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436280832 00000100:00100000:0.0:1787856683.119019:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436280832 00000100:00100000:0.0:1787856683.119055:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787856683.119063:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436280832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856683.119074:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856683.119085:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ff600/0xc25410d92a3c3ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3ac0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.119106:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ff600/0xc25410d92a3c3ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3ac0 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.119325:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ff600/0xc25410d92a3c3ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3ac0 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.119333:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff600, rc 0) 00000100:00100000:0.0:1787856683.119377:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436280832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 315us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.119383:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787856683.119458:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856683.119471:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.119479:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856683.119531:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.119564:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.119594:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.119637:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436280960 00000100:00100000:0.0:1787856683.119641:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436280960 00000100:00100000:0.0:1787856683.119659:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787856683.119665:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436280960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.119786:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436280960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.119793:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787856683.119957:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436280960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.119995:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436281088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.120031:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.120053:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.120254:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436281088 00000100:00100000:3.0:1787856683.120258:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436281088 00000100:00100000:3.0:1787856683.120281:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787856683.120288:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436281088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.120368:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436281088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.120374:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787856683.120526:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436281088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.120966:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10332:1874703436281216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.121014:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.121044:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.121244:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436281216 00000100:00100000:3.0:1787856683.121248:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436281216 00000100:00100000:3.0:1787856683.121281:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787856683.121288:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:10332:x1874703436281216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856683.121370:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:10332:x1874703436281216:12345-0@lo:502:llog_process_th.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.121377:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787856683.121573:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10332:1874703436281216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856683.121596:0:10332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856683.121603:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856683.121606:0:10332:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787856683.121611:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787856683.121630:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10332:1874703436281344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.121663:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.121690:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.121812:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436281344 00000100:00100000:3.0:1787856683.121816:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436281344 00000100:00100000:0.0:1787856683.121925:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787856683.121934:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:10332:x1874703436281344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856683.122027:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:10332:x1874703436281344:12345-0@lo:502:llog_process_th.0 Request processed in 95us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.122040:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787856683.122277:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10332:1874703436281344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856683.122295:0:10332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856683.122299:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856683.122301:0:10332:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787856683.122305:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1787856683.122573:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1787856683.122597:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787856683.122606:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.122615:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856683.122625:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787856683.122628:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065d3be8000 from 48 10000000:01000000:3.0:1787856683.122638:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787856683.122664:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.122672:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.122680:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856683.122695:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436281472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.122738:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856683.122757:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.122836:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436281472 00000100:00100000:0.0:1787856683.122904:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436281472 00000100:00100000:0.0:1787856683.122936:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787856683.122944:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436281472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856683.122952:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856683.122963:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ff800/0xc25410d92a3c3ad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3ace expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.122993:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ff800/0xc25410d92a3c3ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3ace expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.123004:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ff800/0xc25410d92a3c3ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3ace expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.123013:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff800, rc 0) 00000100:00100000:0.0:1787856683.123051:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436281472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.123058:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787856683.123304:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436281472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856683.123316:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.123330:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856683.123378:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436281600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.123404:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.123422:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.123464:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436281600 00000100:00100000:0.0:1787856683.123468:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436281600 00000100:00100000:0.0:1787856683.123496:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787856683.123503:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436281600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.123605:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436281600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.123612:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787856683.123705:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436281600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.123741:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436281728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.123773:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.123791:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.123995:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436281728 00000100:00100000:1.0:1787856683.124000:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436281728 00000100:00100000:0.0:1787856683.124242:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787856683.124257:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436281728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.124327:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436281728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.124333:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787856683.124419:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436281728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.124601:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10333:1874703436281856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.124633:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856683.125019:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436281856 00000100:00100000:3.0:1787856683.125024:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436281856 00000100:00100000:3.0:1787856683.125047:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787856683.125053:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:10333:x1874703436281856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856683.125150:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:10333:x1874703436281856:12345-0@lo:502:llog_process_th.0 Request processed in 97us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.125158:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787856683.125356:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787856683.125370:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10333:1874703436281856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.125407:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10333:1874703436281984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.125438:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.125458:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787856683.125529:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436281984 00000100:00100000:3.0:1787856683.125532:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436281984 00000100:00100000:3.0:1787856683.125560:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787856683.125566:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:10333:x1874703436281984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856683.125634:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:10333:x1874703436281984:12345-0@lo:502:llog_process_th.0 Request processed in 68us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856683.125641:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787856683.125751:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10333:1874703436281984:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787856683.125770:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787856683.125968:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787856683.126065:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787856683.126074:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.126085:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856683.126093:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787856683.126096:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787856683.126099:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787856683.126138:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.126146:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.126155:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856683.126169:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.126197:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856683.126238:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.126359:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436282112 00000100:00100000:1.0:1787856683.126365:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436282112 00000100:00100000:1.0:1787856683.126402:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787856683.126409:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436282112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856683.126417:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856683.126428:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c3ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3adc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.126450:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c3ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3adc expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.126459:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c3ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3adc expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856683.126467:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37d000, rc 0) 00000100:00100000:1.0:1787856683.126499:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436282112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.126505:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787856683.126700:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856683.126713:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856683.126733:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856683.126777:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856683.126806:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856683.126927:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.127072:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436282240 00000100:00100000:1.0:1787856683.127077:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436282240 00000100:00100000:1.0:1787856683.127096:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787856683.127102:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436282240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856683.127391:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436282240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.127398:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787856683.127489:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.127521:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.127561:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856683.127591:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.128342:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436282368 00000100:00100000:1.0:1787856683.128349:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436282368 00000100:00100000:1.0:1787856683.128380:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787856683.128387:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436282368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856683.128480:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436282368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.128487:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787856683.128574:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.130353:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10334:1874703436282496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856683.130428:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856683.130520:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856683.130571:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436282496 00000100:00100000:1.0:1787856683.130577:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436282496 00000100:00100000:1.0:1787856683.130657:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787856683.130666:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:10334:x1874703436282496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856683.130797:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:10334:x1874703436282496:12345-0@lo:502:llog_process_th.0 Request processed in 132us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856683.130805:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787856683.130886:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10334:1874703436282496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856683.130915:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856683.130940:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856683.130943:0:10334:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787856683.130949:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787856683.130983:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10334:1874703436282624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856683.131016:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856683.131452:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff90660053af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856683.131533:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436282624 00000100:00100000:0.0:1787856683.131539:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436282624 00000100:00100000:0.0:1787856683.131564:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787856683.131571:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:10334:x1874703436282624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856683.131661:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:10334:x1874703436282624:12345-0@lo:502:llog_process_th.0 Request processed in 89us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856683.131668:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787856683.131752:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10334:1874703436282624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856683.131772:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856683.131777:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856683.131778:0:10334:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787856683.131782:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787856683.132140:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787856683.132161:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787856683.132170:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.132180:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856683.132197:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787856683.132199:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9065e9fd0000 from 1 10000000:01000000:0.0:1787856683.132202:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787856683.132255:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.132263:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.132272:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856683.132287:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.132322:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856683.132344:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856683.132485:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436282752 00000100:00100000:2.0:1787856683.132490:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436282752 00000100:00100000:2.0:1787856683.132512:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787856683.132519:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436282752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856683.132528:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856683.132540:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076b800/0xc25410d92a3c3af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3aea expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.132558:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076b800/0xc25410d92a3c3af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3aea expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.132568:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076b800/0xc25410d92a3c3af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3aea expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.132577:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b800, rc 0) 00000100:00100000:2.0:1787856683.132608:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436282752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856683.132614:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787856683.132701:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856683.132714:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.132777:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856683.132823:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856683.132917:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856683.133059:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856683.133177:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436282880 00000100:00100000:2.0:1787856683.133182:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436282880 00000100:00100000:2.0:1787856683.133203:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787856683.133210:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436282880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856683.133300:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436282880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (383us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787856683.133308:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787856683.133568:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436282880:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787856683.133593:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787856683.133607:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856683.133616:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856683.922528:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787856684.459677:0:10371:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd86133c0 20000000:00000080:0.0:1787856684.459708:0:10371:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90660063ac00 uarg=0000000000000000 20000000:01000000:0.0:1787856684.459753:0:10371:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787856684.459759:0:10371:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787856684.459764:0:10371:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787856684.461557:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787856684.461768:0:10371:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787856684.467632:0:10371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787856684.467664:0:10371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787856684.467677:0:10371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787856684.467692:0:10371:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787856684.467711:0:10371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.467741:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5fee00/0xc25410d92a3c37b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.467749:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.467756:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c382e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.467763:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.467772:0:10371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.467780:0:10371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.467816:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.467830:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 9 pid: 6491 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856684.467844:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283008:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856684.471932:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.471951:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 23 pid: 6491 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856684.471981:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283136:0@lo:104: 00000100:00100000:1.0:1787856684.472031:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856684.472082:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c382e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472093:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c382e expref: 23 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856684.472102:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283264:0@lo:104: 00000100:00100000:0.0:1787856684.472105:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436283136 00000100:00100000:0.0:1787856684.472115:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436283136 00000100:00100000:1.0:1787856684.472144:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856684.472181:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.472184:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787856684.472196:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 23 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.472200:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436283264 00000100:00100000:0.0:1787856684.472205:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436283264 00000100:00100000:1.0:1787856684.472210:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283392:0@lo:104: 00000100:00100000:0.0:1787856684.472255:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787856684.472260:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856684.472270:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:10371:x1874703436283136:12345-0@lo:104: 00010000:00010000:0.0:1787856684.472284:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472291:0:10371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5fee00/0xc25410d92a3c37b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472303:0:10371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065fd5fee00/0xc25410d92a3c37b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 23 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856684.472313:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283520:0@lo:104: 00000100:00100000:1.0:1787856684.472343:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856684.472351:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787856684.472358:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787856684.472359:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:10371:x1874703436283136:12345-0@lo:104: Request processed in 94us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856684.472371:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787856684.472384:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283136:0@lo:104: 00000100:00100000:0.0:1787856684.472390:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436283392 00000100:00100000:0.0:1787856684.472396:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436283392 00000100:00100000:0.0:1787856684.472411:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436283520 00000100:00100000:0.0:1787856684.472414:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436283520 00010000:00010000:1.0:1787856684.472433:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787856684.472439:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787856684.472442:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.472448:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c705e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:10371:x1874703436283264:12345-0@lo:104: 00010000:00010000:1.0:1787856684.472460:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1414c20) 00010000:00010000:0.0:1787856684.472463:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856684.472466:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472484:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856684.472493:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856684.472500:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787856684.472519:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787856684.472526:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c705e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:10371:x1874703436283264:12345-0@lo:104: Request processed in 80us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856684.472534:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787856684.472546:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472555:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787856684.472567:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787856684.472575:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:10371:x1874703436283392:12345-0@lo:104: 00010000:00010000:1.0:1787856684.472577:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.472586:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472587:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fea00/0xc25410d92a3c3915 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c391c expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472613:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856684.472617:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472624:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274a800 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856684.472628:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.472640:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787856684.472642:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.472649:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:10371:x1874703436283392:12345-0@lo:104: Request processed in 73us (390us total) trans 0 rc 0/0 10000000:00010000:1.0:1787856684.472657:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.472661:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 10000000:01000000:1.0:1787856684.472669:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787856684.472680:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787856684.472687:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.472689:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:10371:x1874703436283520:12345-0@lo:104: 00010000:00010000:1.0:1787856684.472701:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856684.472703:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472710:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472719:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274a800/0xc25410d92a3c382e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3835 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472731:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856684.472734:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.472737:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787856684.472742:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a200 already unused, calling callback (ffffffffc1414c20) 00000100:00100000:0.0:1787856684.472747:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:10371:x1874703436283520:12345-0@lo:104: Request processed in 59us (402us total) trans 0 rc 0/0 10000000:00010000:1.0:1787856684.472749:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.472763:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787856684.472764:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856684.472773:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856684.472785:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787856684.472793:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856684.472805:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472808:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.472820:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc1414c20) 00010000:00010000:1.0:1787856684.472822:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1787856684.472826:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.472837:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472839:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856684.472850:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.472853:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076a200/0xc25410d92a3c3812 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3819 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856684.472867:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787856684.472873:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856684.472877:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856684.472879:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856684.472888:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856684.472892:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436283648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856684.472903:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856684.472913:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.472920:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c37a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c37b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856684.472929:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856684.472942:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856684.472946:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856684.472949:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856684.472953:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856684.472962:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436283904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856684.472963:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436283776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856684.473004:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856684.473011:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436284032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856684.473043:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856684.473053:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436283648 00000100:00100000:0.0:1787856684.473058:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436283648 00000100:00100000:1.0:1787856684.473077:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436283904 00000100:00100000:1.0:1787856684.473082:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436283904 00010000:00010000:0.0:1787856684.473086:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 24 pid: 6491 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.473103:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 25 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.473109:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436284032 00000100:00100000:0.0:1787856684.473114:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436284032 00010000:00010000:0.0:1787856684.473141:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5fee00/0xc25410d92a3c37b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 26 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.473156:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787856684.473162:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+26:3623:x1874703436283648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856684.473172:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856684.473177:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 26 pid: 6491 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473186:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 26 pid: 6491 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473200:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c391c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3915 expref: 26 pid: 6491 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473213:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856684.473264:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+25:3623:x1874703436283648:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856684.473271:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787856684.473285:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787856684.473291:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436283904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856684.473298:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856684.473302:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 24 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473321:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 24 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473331:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856684.473360:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436283904:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856684.473367:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787856684.473383:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787856684.473389:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+23:3626:x1874703436284032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856684.473398:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856684.473402:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5fee00/0xc25410d92a3c37b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 23 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473411:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5fee00/0xc25410d92a3c37b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 23 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473420:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856684.473447:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+23:3626:x1874703436284032:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856684.473453:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787856684.473489:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436284032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856684.473512:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436283904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856684.473526:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856684.473552:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436283648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856684.473571:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436283776 00000100:00100000:0.0:1787856684.473575:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436283776 00010000:00010000:0.0:1787856684.473597:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c382e expref: 23 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.473616:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787856684.473622:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436283776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856684.473628:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856684.473632:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c382e expref: 23 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473641:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c382e expref: 23 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.473650:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856684.473674:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436283776:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856684.473680:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787856684.473722:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436283776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787856684.473842:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856684.474361:0:10371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274a400/0xc25410d92a3c3835 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c382e expref: 22 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856684.474374:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283264:0@lo:104: 00010000:00010000:2.0:1787856684.474384:0:10371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3819 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3812 expref: 21 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856684.474391:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283392:0@lo:104: 00010000:00010000:2.0:1787856684.474399:0:10371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5fee00/0xc25410d92a3c37b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c37a9 expref: 20 pid: 6490 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856684.474406:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283520:0@lo:104: 00000100:00100000:2.0:1787856684.476000:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10371:1874703436283008:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856684.476033:0:10371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856684.478108:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856684.478184:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426787712 00000100:00100000:0.0:1787856684.478192:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426787712 00010000:00010000:0.0:1787856684.478383:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 10 pid: 6491 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856684.478422:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:0.0:1787856684.478433:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426787712:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856684.478448:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856684.478455:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 10 pid: 6491 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478468:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 10 pid: 6491 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478500:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076a400/0xc25410d92a3c3a34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e00 expref: 10 pid: 6491 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478518:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478528:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478545:0:8425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478552:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478559:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478567:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478573:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37d800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856684.478578:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478586:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478611:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856684.478638:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856684.478706:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f992ea53-5038-46c1-bdd9-a3b884b74351+9:2401:x1874703426787712:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 274us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856684.478714:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00010000:00010000:1.0:1787856684.478942:0:10371:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.478967:0:10371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.478974:0:10371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37d800/0xc25410d92a3c3af8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856684.947596:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787856685.073367:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787856685.073376:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe85b800 from 4 10000000:01000000:0.0:1787856685.073382:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787856685.073845:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856685.074101:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856685.075082:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856685.075130:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787856685.075210:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856685.075606:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856685.077929:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436284160 00000100:00100000:2.0:1787856685.077944:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436284160 00000100:00100000:2.0:1787856685.078125:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787856685.078138:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436284160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856685.078173:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856685.078205:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3aff expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.078251:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.078263:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.078273:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a400, rc 0) 00000100:00100000:2.0:1787856685.078363:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436284160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.078370:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787856685.078741:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856685.078759:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856685.078767:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856685.078851:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856685.078894:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856685.078933:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856685.079715:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436284288 00000100:00100000:3.0:1787856685.079724:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436284288 00000100:00100000:3.0:1787856685.079770:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787856685.079780:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436284288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856685.079919:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436284288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856685.079927:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787856685.079981:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856685.080026:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856685.080068:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856685.080440:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d213c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.082603:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436284416 00000100:00100000:1.0:1787856685.082617:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436284416 00000100:00100000:1.0:1787856685.082922:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787856685.082934:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436284416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.083092:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436284416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (3022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.083101:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787856685.083340:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856685.083555:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10385:1874703436284544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856685.083597:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.085666:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436284544 00000100:00100000:2.0:1787856685.085675:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436284544 00000100:00100000:2.0:1787856685.085716:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787856685.085725:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:10385:x1874703436284544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.085857:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:10385:x1874703436284544:12345-0@lo:502:llog_process_th.0 Request processed in 133us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.085865:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787856685.086573:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d219c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.086609:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10385:1874703436284544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787856685.086646:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856685.086656:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856685.086660:0:10385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787856685.086672:0:10385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065fe85b800 00000020:00000080:1.0:1787856685.086675:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787856685.086762:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10385:1874703436284672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856685.087021:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856685.087043:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787856685.090932:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436284672 00000100:00100000:2.0:1787856685.090945:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436284672 00000100:00100000:2.0:1787856685.091013:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787856685.091023:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:10385:x1874703436284672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.091400:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:10385:x1874703436284672:12345-0@lo:502:llog_process_th.0 Request processed in 377us (4378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.091419:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787856685.092798:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10385:1874703436284672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787856685.092840:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856685.092848:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856685.092850:0:10385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787856685.092854:0:10385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787856685.092933:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787856685.092950:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787856685.092959:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856685.092970:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856685.092981:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787856685.092983:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe6d5000 from 4 10000000:01000000:0.0:1787856685.092986:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787856685.093017:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856685.093037:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856685.093061:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856685.093086:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787856685.093151:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.093265:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436284800 00000100:00100000:2.0:1787856685.093273:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436284800 00000100:00100000:2.0:1787856685.093319:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787856685.093330:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436284800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856685.093343:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856685.093355:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3b0d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.093378:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.093389:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.093397:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a200, rc 0) 00000100:00100000:0.0:1787856685.093684:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d21c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856685.096464:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436284800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3128us (3304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.096476:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787856685.096545:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856685.096580:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.096592:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856685.096663:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856685.098466:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.098510:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73f0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.101206:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436284928 00000100:00100000:1.0:1787856685.101249:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436284928 00000100:00100000:1.0:1787856685.101315:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787856685.101334:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436284928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.101518:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436284928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.101526:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787856685.109505:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436284928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856685.109572:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436285056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856685.109652:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.109708:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73f0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.109740:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436285056 00000100:00100000:1.0:1787856685.109749:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436285056 00000100:00100000:1.0:1787856685.109817:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787856685.109827:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436285056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.109941:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436285056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.109949:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787856685.110128:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436285056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856685.110663:0:10387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10387:1874703436285184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.110704:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.110734:0:10387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73f0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.110786:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436285184 00000100:00100000:1.0:1787856685.110791:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436285184 00000100:00100000:1.0:1787856685.110827:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787856685.110834:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:10387:x1874703436285184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856685.110912:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:10387:x1874703436285184:12345-0@lo:502:llog_process_th.0 Request processed in 78us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.110919:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787856685.111053:0:10387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10387:1874703436285184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856685.111075:0:10387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856685.111085:0:10387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856685.111088:0:10387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787856685.111094:0:10387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065fe6d5000 00000020:00000080:2.0:1787856685.111097:0:10387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787856685.111196:0:10387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10387:1874703436285312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.111260:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.111282:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436285312 00000100:00100000:2.0:1787856685.111286:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436285312 00000100:00100000:2.0:1787856685.111307:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787856685.111314:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:10387:x1874703436285312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.111373:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:10387:x1874703436285312:12345-0@lo:502:llog_process_th.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.111380:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787856685.111600:0:10387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73f0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856685.111614:0:10387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10387:1874703436285312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856685.111632:0:10387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856685.111636:0:10387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856685.111638:0:10387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787856685.111641:0:10387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787856685.112252:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787856685.112277:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856685.112288:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856685.112299:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856685.112319:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856685.112331:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065f7199800 from 4 10000000:01000000:1.0:1787856685.112334:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856685.112360:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856685.112368:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856685.112376:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856685.112391:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436285440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.112555:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856685.112588:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856685.113530:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436285440 00000100:00100000:2.0:1787856685.113540:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436285440 00000100:00100000:2.0:1787856685.113582:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787856685.113590:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436285440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856685.113602:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856685.113616:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3b1b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.113640:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.113652:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.113660:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b600, rc 0) 00000100:00100000:2.0:1787856685.113708:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436285440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.113715:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787856685.113759:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436285440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856685.116543:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.116566:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856685.116667:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436285568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856685.116732:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.116782:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73f0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.119179:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436285568 00000100:00100000:1.0:1787856685.119200:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436285568 00000100:00100000:1.0:1787856685.119281:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787856685.119291:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436285568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.119773:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436285568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 483us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.119781:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787856685.119863:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436285568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856685.119910:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436285696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856685.119961:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.119998:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73f0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.120315:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436285696 00000100:00100000:1.0:1787856685.120320:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436285696 00000100:00100000:1.0:1787856685.120346:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787856685.120353:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436285696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.120441:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436285696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.120448:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787856685.120576:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436285696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856685.123073:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10389:1874703436285824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.123161:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.123210:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73f0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.123389:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436285824 00000100:00100000:1.0:1787856685.123400:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436285824 00000100:00100000:1.0:1787856685.123467:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787856685.123477:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+23:10389:x1874703436285824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856685.123592:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+23:10389:x1874703436285824:12345-0@lo:502:llog_process_th.0 Request processed in 115us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.123600:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787856685.123786:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10389:1874703436285824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856685.123812:0:10389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856685.123821:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856685.123824:0:10389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787856685.123831:0:10389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065f7199800 00000020:00000080:2.0:1787856685.123834:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787856685.123909:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10389:1874703436285952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.123942:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856685.123965:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436285952 00000100:00100000:2.0:1787856685.123970:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436285952 00000100:00100000:2.0:1787856685.123991:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787856685.123998:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:10389:x1874703436285952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.124064:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:10389:x1874703436285952:12345-0@lo:502:llog_process_th.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.124070:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787856685.124101:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73f0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856685.124489:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10389:1874703436285952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856685.124511:0:10389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856685.124516:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856685.124518:0:10389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787856685.124520:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787856685.127936:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787856685.127973:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856685.127984:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856685.127997:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856685.128007:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856685.128010:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065d3be8000 from 4 10000000:01000000:1.0:1787856685.128013:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856685.128049:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856685.128058:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856685.128069:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856685.128092:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436286080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.128323:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856685.128364:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856685.128469:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436286080 00000100:00100000:2.0:1787856685.128477:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436286080 00000100:00100000:2.0:1787856685.128520:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787856685.128528:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436286080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856685.128540:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856685.128552:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3b29 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.128575:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.128585:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856685.128594:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b200, rc 0) 00000100:00100000:2.0:1787856685.128634:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436286080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.128641:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787856685.132184:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436286080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856685.132240:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856685.132253:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856685.132342:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436286208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.132410:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856685.132440:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.132470:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436286208 00000100:00100000:1.0:1787856685.132476:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436286208 00000100:00100000:1.0:1787856685.132518:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787856685.132527:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436286208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.132644:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436286208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.132651:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787856685.132688:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436286208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.132714:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436286336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.132753:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856685.132765:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856685.134012:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436286336 00000100:00100000:0.0:1787856685.134019:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436286336 00000100:00100000:0.0:1787856685.134054:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787856685.134062:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436286336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856685.134188:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436286336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856685.134195:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787856685.134535:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436286336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856685.137927:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10390:1874703436286464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856685.138010:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856685.138395:0:10390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d21a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856685.138630:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436286464 00000100:00100000:1.0:1787856685.138637:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436286464 00000100:00100000:1.0:1787856685.138684:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787856685.138694:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:10390:x1874703436286464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856685.138817:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:10390:x1874703436286464:12345-0@lo:502:llog_process_th.0 Request processed in 124us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.138824:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787856685.138906:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10390:1874703436286464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856685.138938:0:10390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856685.138947:0:10390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856685.138950:0:10390:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787856685.138956:0:10390:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065d3be8000 00000020:00000080:2.0:1787856685.138958:0:10390:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787856685.139043:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10390:1874703436286592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856685.139077:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856685.139107:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436286592 00000100:00100000:2.0:1787856685.139108:0:10390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe90e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787856685.139128:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436286592 00000100:00100000:3.0:1787856685.139170:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787856685.139179:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:10390:x1874703436286592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856685.139288:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:10390:x1874703436286592:12345-0@lo:502:llog_process_th.0 Request processed in 111us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856685.139295:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787856685.139650:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:10390:1874703436286592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856685.139673:0:10390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856685.139679:0:10390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856685.139681:0:10390:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787856685.139685:0:10390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787856685.139910:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787856685.139935:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856685.139944:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856685.139955:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856685.600773:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856685.600907:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426787840 00000100:00100000:3.0:1787856685.600918:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426787840 00000100:00100000:3.0:1787856685.601073:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 269 00000100:00100000:3.0:1787856685.601094:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+9:6174:x1874703426787840:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856685.601121:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856685.601139:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5e46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856685.601168:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856685.601197:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856685.601206:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274ae00, rc 0) 00000100:00100000:3.0:1787856685.601321:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6174:x1874703426787840:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 238us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856685.601329:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 269 00000100:00100000:0.0:1787856685.614732:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856685.614804:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426787968 00000100:00100000:1.0:1787856685.614813:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426787968 00000100:00100000:1.0:1787856685.614868:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 270 00000100:00100000:1.0:1787856685.614878:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6174:x1874703426787968:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856685.615036:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6174:x1874703426787968:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 158us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856685.615044:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 270 00000100:00100000:1.0:1787856685.619498:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856685.619582:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426788096 00000100:00100000:3.0:1787856685.619592:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426788096 00000100:00100000:3.0:1787856685.619645:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 271 00000100:00100000:3.0:1787856685.619656:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6174:x1874703426788096:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856685.619807:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6174:x1874703426788096:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856685.619815:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 271 00000100:00100000:3.0:1787856685.629584:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856685.629700:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426788224 00000100:00100000:2.0:1787856685.629710:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426788224 00000100:00100000:2.0:1787856685.629771:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 272 00000100:00100000:2.0:1787856685.629782:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6706:x1874703426788224:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856685.629966:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6706:x1874703426788224:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 184us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856685.629975:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 272 00000100:00100000:0.0:1787856685.659304:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856685.659378:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426788352 00000100:00100000:3.0:1787856685.659387:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426788352 00000100:00100000:3.0:1787856685.659439:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 273 00000100:00100000:3.0:1787856685.659448:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6706:x1874703426788352:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787856685.659577:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:6706:x1874703426788352:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 129us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856685.659585:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 273 00010000:00010000:1.0:1787856685.970935:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856686.417981:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436286720:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.418059:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856686.418529:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436286976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856686.418563:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856686.418606:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436286976 00000100:00100000:1.0:1787856686.418627:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436286976 00000100:00100000:1.0:1787856686.418680:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787856686.418690:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436286976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856686.418730:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856686.418777:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436286976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856686.418784:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787856686.418806:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787856686.418835:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7ab8000 x1874703436286976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856686.418853:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436286976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856686.418996:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436287104:0@lo:400:kworker.0 00000100:00100000:1.0:1787856686.419025:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856686.419055:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436287104 00000100:00100000:1.0:1787856686.419058:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436287104 00000100:00100000:1.0:1787856686.419112:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787856686.419120:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436287104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856686.419154:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436287104:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856686.419161:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787856686.419190:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436287104:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.419599:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436287232:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.419648:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856686.419673:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856686.419681:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436286848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856686.419705:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856686.419739:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436286720 00000100:00100000:3.0:1787856686.419744:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436286720 00000100:00100000:3.0:1787856686.419774:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787856686.419781:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436286720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.419817:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436286720:12345-0@lo:400:kworker.0 Request processed in 36us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856686.419823:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787856686.419880:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436287232 00000100:00100000:3.0:1787856686.419883:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436287232 00000100:00100000:3.0:1787856686.419905:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787856686.419910:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436287232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.419942:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436287232:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856686.419948:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787856686.419965:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436286848 00000100:00100000:3.0:1787856686.419969:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436286848 00000100:00100000:3.0:1787856686.419994:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787856686.420000:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436286848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856686.420018:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856686.420048:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436286848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856686.420053:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787856686.420122:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2fc00 x1874703436286848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856686.420136:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436286848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856686.420147:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436287232:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.420154:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436286720:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.420170:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856686.420175:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436287360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856686.420198:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856686.420907:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436287360 00000100:00100000:1.0:1787856686.420913:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436287360 00000100:00100000:1.0:1787856686.420949:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856686.420957:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436287360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856686.420972:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856686.421009:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436287360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856686.421025:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787856686.421045:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787856686.421642:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5d2c0 x1874703436287360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856686.421660:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436287360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856686.424295:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436287488:0@lo:400:kworker.0 00000100:00100000:2.0:1787856686.424742:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856686.424826:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436287616:0@lo:400:kworker.0 00000100:00100000:2.0:1787856686.424856:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856686.424919:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436288000:0@lo:400:kworker.0 00000100:00100000:2.0:1787856686.424942:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856686.424994:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436288128:0@lo:400:kworker.0 00000100:00100000:2.0:1787856686.425019:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856686.425051:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436287488 00000100:00100000:2.0:1787856686.425056:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436287488 00000100:00100000:3.0:1787856686.425184:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436288000 00000100:00100000:3.0:1787856686.425188:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436288000 00000100:00100000:3.0:1787856686.425248:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436288128 00000100:00100000:3.0:1787856686.425252:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436288128 00000100:00100000:3.0:1787856686.425276:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787856686.425285:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436288000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.425354:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436288000:12345-0@lo:400:kworker.0 Request processed in 70us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856686.425361:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787856686.425377:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787856686.425382:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436288128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.425413:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436288128:12345-0@lo:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856686.425419:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787856686.425446:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436287872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.425472:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856686.425491:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787856686.425497:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436287744:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.425520:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856686.425554:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436287872 00000100:00100000:3.0:1787856686.425557:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436287872 00000100:00100000:3.0:1787856686.425578:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787856686.425584:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436287872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.425800:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436287872:12345-0@lo:400:kworker.0 Request processed in 215us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856686.425806:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787856686.425825:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856686.425828:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787856686.425860:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2b840 x1874703436288000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856686.425873:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436288000:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.425900:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436288128:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.425916:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436287616 00000100:00100000:3.0:1787856686.425920:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436287616 00000100:00100000:3.0:1787856686.425945:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787856686.425952:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436287616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.425988:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436287616:12345-0@lo:400:kworker.0 Request processed in 37us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856686.425994:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787856686.426021:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436287616:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.426056:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436287872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.426881:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436288256:0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.426922:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856686.426961:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436288256 00000100:00100000:3.0:1787856686.426966:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436288256 00000100:00100000:3.0:1787856686.427001:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787856686.427008:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436288256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856686.427045:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436288256:12345-0@lo:400:kworker.0 Request processed in 37us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856686.427050:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787856686.427068:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856686.428033:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436287744 00000100:00100000:0.0:1787856686.428041:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436287744 00000100:00100000:0.0:1787856686.428107:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856686.428116:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436287744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856686.428183:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436287744:12345-0@lo:400:kworker.0 Request processed in 69us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856686.428190:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787856686.428210:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787856686.428251:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b292c0 x1874703436287744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856686.428265:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436287744:0@lo:400:kworker.0 00000100:00100000:2.0:1787856686.428449:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787856686.428460:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436287488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856686.428517:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436287488:12345-0@lo:400:kworker.0 Request processed in 60us (3776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856686.428524:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787856686.428731:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436287488:0@lo:400:kworker.0 00010000:00080000:3.0:1787856686.428817:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5f480 x1874703436288256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856686.428828:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436288256:0@lo:400:kworker.0 00000100:00100000:0.0:1787856686.929603:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856686.929626:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436288384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856686.929719:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856686.929869:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436288384 00000100:00100000:0.0:1787856686.929877:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436288384 00000100:00100000:0.0:1787856686.929921:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787856686.929930:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436288384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856686.929952:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856686.929996:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436288384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856686.930004:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787856686.930046:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2c000 x1874703436288384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856686.930066:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436288384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787856686.995164:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856687.444675:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436288512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856687.444752:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856687.444993:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436288512 00000100:00100000:0.0:1787856687.445000:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436288512 00000100:00100000:0.0:1787856687.445052:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787856687.445072:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436288512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856687.445114:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856687.445173:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436288512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856687.445180:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787856687.445389:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436288512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856687.586439:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856687.586677:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856687.586712:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856687.586742:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856687.586791:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856687.586822:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426788736 00000100:00100000:3.0:1787856687.586831:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426788736 00000100:00100000:3.0:1787856687.586890:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426788608 00000100:00100000:3.0:1787856687.586894:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426788608 00000100:00100000:3.0:1787856687.586918:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:3.0:1787856687.586939:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426788736:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856687.587134:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:1.0:1787856687.587144:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d275b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426788608:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856687.587212:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426788992 00000100:00100000:2.0:1787856687.587241:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426788992 00000100:00100000:2.0:1787856687.587271:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426788864 00000100:00100000:2.0:1787856687.587274:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426788864 00000100:00100000:2.0:1787856687.587288:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1787856687.587294:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426788992:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856687.587381:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426788736:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 443us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856687.587389:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:3.0:1787856687.587412:0:8409:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787856687.587418:0:8409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787856687.594191:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426788480 00000100:00100000:0.0:1787856687.594207:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426788480 00000100:00100000:0.0:1787856687.594312:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 275 00000100:00100000:0.0:1787856687.594323:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2400:x1874703426788480:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856687.594473:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d275b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426788608:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 7329us (7727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856687.594484:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00080000:1.0:1787856687.594602:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856687.594608:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787856687.594611:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856687.594615:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856687.596414:0:8407:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787856687.596440:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:1.0:1787856687.596457:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426788864:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856687.596519:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426788864:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 68us (9728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856687.596526:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1787856687.597010:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426788992:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 9714us (10295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856687.597018:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1787856687.600317:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2400:x1874703426788480:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 5982us (13876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856687.600332:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 275 00000100:00100000:3.0:1787856687.953922:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856687.953948:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436288640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856687.954014:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856687.954317:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436288640 00000100:00100000:0.0:1787856687.954325:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436288640 00000100:00100000:0.0:1787856687.954378:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787856687.954388:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7061e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436288640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787856687.954425:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787856687.954479:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7061e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436288640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856687.954485:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787856687.954528:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436288640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787856688.022702:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856689.045449:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856690.070352:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787856691.023612:0:10672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787856691.092003:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856691.537787:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436288768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856691.537864:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856691.537942:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787856691.537949:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436288896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856691.537971:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856691.538071:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436288768 00000100:00100000:0.0:1787856691.538078:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436288768 00000100:00100000:0.0:1787856691.538140:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436288896 00000100:00100000:0.0:1787856691.538143:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436288896 00000100:00100000:0.0:1787856691.538182:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856691.538192:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436288768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856691.538199:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436289024:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856691.538243:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856691.538258:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856691.538305:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436288768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856691.538315:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856691.538335:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436289024 00000100:00100000:0.0:1787856691.538339:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436289024 00000100:00100000:0.0:1787856691.538361:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856691.538371:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436288896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856691.538384:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856691.538399:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436289152:0@lo:400:kworker.0 00000100:00100000:0.0:1787856691.538412:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436288896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856691.538419:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856691.538434:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787856691.538440:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856691.538445:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436289024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856691.538465:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856691.538481:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436289664:0@lo:400:kworker.0 00000100:00100000:0.0:1787856691.538496:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436289024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856691.538503:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787856691.538514:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856691.538539:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436290176:0@lo:400:kworker.0 00000100:00100000:1.0:1787856691.538563:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856691.538581:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787856691.538586:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436289536:0@lo:400:kworker.0 00000100:00100000:1.0:1787856691.538608:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856691.538624:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436290048:0@lo:400:kworker.0 00000100:00100000:1.0:1787856691.538644:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787856691.538679:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7ab9a40 x1874703436289024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856691.538694:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436289024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856691.538762:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436289664 00000100:00100000:0.0:1787856691.538766:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436289664 00000100:00100000:0.0:1787856691.538802:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787856691.538809:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436289664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856691.538850:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436289664:12345-0@lo:400:kworker.0 Request processed in 41us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856691.538865:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787856691.538895:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436289664:0@lo:400:kworker.0 00000100:00080000:2.0:1787856691.538963:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787856691.538967:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856691.538984:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436289408:0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539014:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856691.539047:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436289920:0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539079:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856691.539100:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787856691.539106:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436289280:0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539127:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856691.539141:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436289792:0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539163:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856691.539178:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436290304:0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539198:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856691.539243:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436290176 00000100:00100000:2.0:1787856691.539248:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436290176 00000100:00100000:2.0:1787856691.539286:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436289536 00000100:00100000:2.0:1787856691.539289:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436289536 00000100:00100000:2.0:1787856691.539300:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436290048 00000100:00100000:2.0:1787856691.539302:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436290048 00000100:00100000:2.0:1787856691.539313:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436289920 00000100:00100000:2.0:1787856691.539316:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436289920 00000100:00100000:2.0:1787856691.539327:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436289280 00000100:00100000:2.0:1787856691.539329:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436289280 00000100:00100000:2.0:1787856691.539337:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436290304 00000100:00100000:2.0:1787856691.539338:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436290304 00000100:00100000:2.0:1787856691.539350:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787856691.539356:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436290176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539391:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436290176:12345-0@lo:400:kworker.0 Request processed in 35us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856691.539398:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787856691.539418:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787856691.539423:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436289536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539452:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436289536:12345-0@lo:400:kworker.0 Request processed in 29us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856691.539458:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787856691.539468:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787856691.539474:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436290048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539500:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436290048:12345-0@lo:400:kworker.0 Request processed in 26us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856691.539506:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787856691.539516:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787856691.539521:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.539564:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436289920:12345-0@lo:400:kworker.0 Request processed in 43us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856691.539570:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787856691.539580:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787856691.539586:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436289280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856691.539839:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436289408 00000100:00100000:0.0:1787856691.539844:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436289408 00000100:00100000:0.0:1787856691.539864:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787856691.539870:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436289408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856691.539903:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436289408:12345-0@lo:400:kworker.0 Request processed in 33us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856691.539909:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787856691.539940:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856691.539944:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787856691.539968:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2e940 x1874703436288896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856691.539984:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436288896:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787856691.539998:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7062d00 x1874703436288768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856691.540010:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436288768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856691.540023:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787856691.540035:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436290304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.540127:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436289280:12345-0@lo:400:kworker.0 Request processed in 540us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856691.540135:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787856691.540151:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436290304:12345-0@lo:400:kworker.0 Request processed in 117us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856691.540160:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787856691.540172:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436289280:0@lo:400:kworker.0 00010000:00080000:2.0:1787856691.540187:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7ab8f00 x1874703436290304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856691.540187:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436289792 00000100:00100000:1.0:1787856691.540193:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436289792 00000100:00100000:2.0:1787856691.540200:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436290304:0@lo:400:kworker.0 00000100:00100000:1.0:1787856691.540254:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787856691.540263:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436289792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856691.540295:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436289792:12345-0@lo:400:kworker.0 Request processed in 34us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856691.540301:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787856691.540318:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856691.540467:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436289536:0@lo:400:kworker.0 00010000:00080000:0.0:1787856691.540479:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7abbc00 x1874703436290048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856691.540488:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436290048:0@lo:400:kworker.0 00000100:00100000:0.0:1787856691.540500:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436290176:0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.540710:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436289408:0@lo:400:kworker.0 00000100:00100000:2.0:1787856691.540730:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436289920:0@lo:400:kworker.0 00010000:00080000:2.0:1787856691.540751:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7aba1c0 x1874703436289792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856691.540760:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436289792:0@lo:400:kworker.0 00000100:00100000:3.0:1787856691.540856:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436289152 00000100:00100000:3.0:1787856691.540863:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436289152 00000100:00100000:3.0:1787856691.540904:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787856691.540912:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436289152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856691.540963:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436289152:12345-0@lo:400:kworker.0 Request processed in 53us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856691.540970:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787856691.541141:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436289152:0@lo:400:kworker.0 00000100:00100000:2.0:1787856692.049672:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436290432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856692.049839:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856692.052138:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436290432 00000100:00100000:0.0:1787856692.052151:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436290432 00000100:00100000:0.0:1787856692.052249:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787856692.052271:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436290432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856692.052297:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856692.052373:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436290432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856692.052381:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787856692.052978:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2cf00 x1874703436290432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856692.053003:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436290432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787856692.121059:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856692.562633:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436290560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856692.562708:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856692.566314:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436290560 00000100:00100000:0.0:1787856692.566326:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436290560 00000100:00100000:0.0:1787856692.566394:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787856692.566405:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436290560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856692.566442:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856692.566530:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436290560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (3822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856692.566538:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787856692.566593:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436290560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856692.711905:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856692.711945:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856692.711983:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856692.712004:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856692.712053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856692.712102:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426789248 00000100:00100000:3.0:1787856692.712112:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426789248 00000100:00100000:3.0:1787856692.712172:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426789376 00000100:00100000:3.0:1787856692.712177:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426789376 00000100:00100000:3.0:1787856692.712210:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:3.0:1787856692.712247:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426789248:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856692.712317:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426789248:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 72us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856692.712324:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:3.0:1787856692.712341:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:3.0:1787856692.712347:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7063c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426789376:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856692.712373:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7063c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426789376:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856692.712379:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:3.0:1787856692.712399:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426789120 00000100:00100000:3.0:1787856692.712402:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426789120 00000100:00100000:3.0:1787856692.712426:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00100000:3.0:1787856692.712433:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2400:x1874703426789120:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856692.712457:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2400:x1874703426789120:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856692.712463:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00080000:3.0:1787856692.712493:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856692.712497:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856692.713116:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426789504 00000100:00100000:3.0:1787856692.713122:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426789504 00000100:00100000:3.0:1787856692.713159:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426789632 00000100:00100000:3.0:1787856692.713162:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426789632 00000100:00100000:3.0:1787856692.713201:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:3.0:1787856692.713209:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7061a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426789504:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856692.713616:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7061a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426789504:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 407us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856692.713624:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:3.0:1787856692.713639:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1787856692.713645:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426789632:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856692.713668:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426789632:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856692.713674:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00080000:3.0:1787856692.715988:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856692.715997:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856693.073435:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436290688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856693.073511:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856693.073657:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436290688 00000100:00100000:3.0:1787856693.073670:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436290688 00000100:00100000:3.0:1787856693.073732:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787856693.073742:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436290688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856693.073788:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856693.073854:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436290688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856693.073862:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787856693.074067:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436290688:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787856693.137652:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856694.164928:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856695.195077:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856696.210173:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856696.661494:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436290816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856696.661586:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856696.661674:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436290944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856696.661707:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856696.661741:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856696.661748:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436291072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856696.661771:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856696.661819:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436290816 00000100:00100000:1.0:1787856696.661827:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436290816 00000100:00100000:1.0:1787856696.661881:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436290944 00000100:00100000:1.0:1787856696.661884:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436290944 00000100:00100000:1.0:1787856696.661897:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436291072 00000100:00100000:1.0:1787856696.661900:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436291072 00000100:00100000:1.0:1787856696.661915:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787856696.661923:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436290816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856696.661955:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856696.662024:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436290816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856696.662032:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787856696.662064:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787856696.662072:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436290944:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787856696.662085:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2c000 x1874703436290816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1787856696.662091:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856696.662110:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436290816:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787856696.662140:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7aba1c0 x1874703436290944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856696.662142:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436290944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856696.662159:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787856696.662163:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436290944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856696.662181:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787856696.662190:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436291072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787856696.662201:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856696.662249:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436291072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856696.662255:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787856696.662274:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856696.662278:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787856696.662354:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7aba580 x1874703436291072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856696.662367:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436291072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856696.663399:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436291584:0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.663443:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856696.663478:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436292096:0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.663494:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436291584 00000100:00100000:2.0:1787856696.663501:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856696.663502:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436291584 00000100:00100000:3.0:1787856696.663542:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436292096 00000100:00100000:3.0:1787856696.663545:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436292096 00000100:00100000:3.0:1787856696.663571:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787856696.663579:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436291584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.663632:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436291584:12345-0@lo:400:kworker.0 Request processed in 54us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856696.663639:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787856696.663654:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787856696.663660:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436292096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.663694:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436292096:12345-0@lo:400:kworker.0 Request processed in 34us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856696.663696:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436291584:0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.663706:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1787856696.663717:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8246940 x1874703436292096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856696.663729:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436292096:0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.663746:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787856696.663753:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8244b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436291456:0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.664396:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856696.664427:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8244780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436291968:0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.664432:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436291456 00000100:00100000:2.0:1787856696.664437:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436291456 00000100:00100000:3.0:1787856696.664461:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856696.664473:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787856696.664481:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436291456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.664496:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436291968 00000100:00100000:3.0:1787856696.664501:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436291968 00000100:00100000:3.0:1787856696.664529:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787856696.664536:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7062580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436291968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.664573:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7062580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436291968:12345-0@lo:400:kworker.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856696.664580:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787856696.664609:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8244780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436291968:0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.664783:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436291456:12345-0@lo:400:kworker.0 Request processed in 302us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856696.664792:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787856696.665028:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8244b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436291456:0@lo:400:kworker.0 00000100:00100000:1.0:1787856696.665236:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436291200:0@lo:400:kworker.0 00000100:00100000:1.0:1787856696.665279:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856696.665313:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436291712:0@lo:400:kworker.0 00000100:00100000:1.0:1787856696.665337:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856696.665356:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8244f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436292224:0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.665369:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436291712 00000100:00100000:2.0:1787856696.665376:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436291712 00000100:00100000:1.0:1787856696.665381:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856696.665409:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787856696.665409:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787856696.665420:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436291328:0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.665422:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436291712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856696.665452:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856696.665479:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436291712:12345-0@lo:400:kworker.0 Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856696.665480:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436291840:0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.665494:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787856696.665515:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856696.665540:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436292352:0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.665541:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436291840 00000100:00100000:2.0:1787856696.665547:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436291840 00000100:00100000:1.0:1787856696.665569:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856696.665591:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787856696.665601:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436291712:0@lo:400:kworker.0 00000100:00100000:1.0:1787856696.665641:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436292224 00000100:00100000:1.0:1787856696.665645:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436292224 00000100:00100000:2.0:1787856696.665680:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436291840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.665724:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436291840:12345-0@lo:400:kworker.0 Request processed in 126us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856696.665731:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787856696.666019:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436291200 00000100:00100000:3.0:1787856696.666024:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436291200 00000100:00100000:3.0:1787856696.666059:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787856696.666066:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436291200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.666105:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436291200:12345-0@lo:400:kworker.0 Request processed in 40us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856696.666119:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787856696.666560:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436291328 00000100:00100000:1.0:1787856696.666565:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436291328 00000100:00100000:1.0:1787856696.666589:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436292352 00000100:00100000:1.0:1787856696.666592:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436292352 00000100:00100000:1.0:1787856696.666611:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787856696.666617:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436292224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856696.666667:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787856696.666677:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436291328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856696.666736:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787856696.666746:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856696.666773:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436292224:12345-0@lo:400:kworker.0 Request processed in 155us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856696.666781:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787856696.666800:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436291328:12345-0@lo:400:kworker.0 Request processed in 123us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856696.666802:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436292352:12345-0@lo:400:kworker.0 Request processed in 57us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856696.666815:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787856696.666825:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787856696.666825:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436291328:0@lo:400:kworker.0 00010000:00080000:1.0:1787856696.666842:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8246580 x1874703436291840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856696.666853:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436291840:0@lo:400:kworker.0 00010000:00080000:1.0:1787856696.666864:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8245680 x1874703436292352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856696.666873:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436292352:0@lo:400:kworker.0 00000100:00100000:1.0:1787856696.666881:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436291200:0@lo:400:kworker.0 00000100:00100000:1.0:1787856696.666891:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8244f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436292224:0@lo:400:kworker.0 00000100:00080000:1.0:1787856696.666917:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856696.666922:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856696.666924:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1787856696.946674:0:10915:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing yml_node 00000100:00100000:1.0:1787856697.173559:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436292480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856697.173639:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856697.173708:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436292480 00000100:00100000:1.0:1787856697.173716:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436292480 00000100:00100000:1.0:1787856697.173770:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787856697.173779:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436292480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856697.173800:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856697.173842:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436292480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856697.173850:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787856697.173885:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7aba580 x1874703436292480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856697.173903:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436292480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856697.238153:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856697.681671:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436292608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856697.681751:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856697.681938:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436292608 00000100:00100000:3.0:1787856697.681947:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436292608 00000100:00100000:3.0:1787856697.682007:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787856697.682017:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436292608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856697.682051:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856697.682098:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436292608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856697.682105:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787856697.682191:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436292608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856697.836048:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856697.836091:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856697.836117:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856697.836144:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856697.836241:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856697.836268:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426790144 00000100:00100000:0.0:1787856697.836278:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426790144 00000100:00100000:0.0:1787856697.836334:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426790272 00000100:00100000:0.0:1787856697.836338:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426790272 00000100:00100000:0.0:1787856697.836365:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1787856697.836384:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2398:x1874703426790144:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:0.0:1787856697.836422:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3a49 00000100:00080000:0.0:1787856697.836431:0:8409:0:(import.c:65:import_set_state_nolock()) ffff90660191b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787856697.836472:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787856697.836630:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+2:2398:x1874703426790144:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 247us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856697.836638:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1787856697.836655:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1787856697.836663:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2398:x1874703426790272:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:0.0:1787856697.836676:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3a50 00000100:00080000:0.0:1787856697.836683:0:8409:0:(import.c:65:import_set_state_nolock()) ffff906601918800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787856697.836705:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787856697.836773:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+2:2398:x1874703426790272:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 110us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856697.836780:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00010000:00010000:0.0:1787856697.836847:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856697.836852:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426789760 00000100:00100000:3.0:1787856697.836857:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426789760 00000100:00100000:3.0:1787856697.836887:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:3.0:1787856697.836894:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2402:x1874703426789760:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856697.836927:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2402:x1874703426789760:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856697.836934:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 279 00010000:00010000:2.0:1787856697.837080:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856697.837340:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426789888 00000100:00100000:0.0:1787856697.837345:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426789888 00000100:00100000:0.0:1787856697.837383:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426790016 00000100:00100000:0.0:1787856697.837387:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426790016 00000100:00100000:0.0:1787856697.837409:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:0.0:1787856697.837416:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426789888:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856697.837455:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426789888:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 40us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856697.837463:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:0.0:1787856697.837477:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:0.0:1787856697.837491:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426790016:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856697.837527:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426790016:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 37us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856697.837535:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00080000:1.0:1787856697.837839:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856697.837843:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856697.837846:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787856697.837847:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856698.195509:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436292736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856698.195596:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856698.195701:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436292736 00000100:00100000:2.0:1787856698.195708:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436292736 00000100:00100000:2.0:1787856698.195764:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787856698.195773:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436292736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856698.195804:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787856698.195848:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436292736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856698.195855:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787856698.195936:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436292736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856698.258903:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856699.282093:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856700.307188:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856701.329481:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856701.777398:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436292864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856701.777484:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856701.777485:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856701.777500:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436293120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856701.777530:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856701.777568:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436292992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856701.777593:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.777726:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8245e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436293376:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.777762:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.777782:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8244f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436293888:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.777806:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.777841:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436294400:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.777872:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.777893:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787856701.777899:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436293504:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.777947:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.777976:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436294016:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.777998:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.778026:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436293888 00000100:00100000:2.0:1787856701.778032:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436293888 00000100:00100000:2.0:1787856701.778085:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787856701.778095:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436293888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778141:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436293888:12345-0@lo:400:kworker.0 Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778149:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787856701.778170:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436293504 00000100:00100000:2.0:1787856701.778173:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436293504 00000100:00100000:2.0:1787856701.778196:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787856701.778202:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436293504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778252:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436293504:12345-0@lo:400:kworker.0 Request processed in 50us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778258:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787856701.778278:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8247840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436293632:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778299:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.778314:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436294144:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778332:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.778345:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787856701.778351:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436293248:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778372:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.778391:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436293760:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778420:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.778434:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436294272:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778452:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856701.778471:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436293376 00000100:00100000:2.0:1787856701.778475:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436293376 00000100:00100000:2.0:1787856701.778492:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436294400 00000100:00100000:2.0:1787856701.778495:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436294400 00000100:00100000:2.0:1787856701.778506:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436294016 00000100:00100000:2.0:1787856701.778508:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436294016 00000100:00100000:2.0:1787856701.778517:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436293632 00000100:00100000:2.0:1787856701.778519:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436293632 00000100:00100000:2.0:1787856701.778527:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436294144 00000100:00100000:2.0:1787856701.778530:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436294144 00000100:00100000:2.0:1787856701.778541:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436294272 00000100:00100000:2.0:1787856701.778543:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436294272 00000100:00100000:2.0:1787856701.778556:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787856701.778562:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436293376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778591:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436293376:12345-0@lo:400:kworker.0 Request processed in 29us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778598:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787856701.778609:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787856701.778614:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8244780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436294400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778638:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8244780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436294400:12345-0@lo:400:kworker.0 Request processed in 25us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778644:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787856701.778653:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787856701.778658:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436294016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778680:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436294016:12345-0@lo:400:kworker.0 Request processed in 22us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778691:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787856701.778701:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787856701.778707:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436293632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778734:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436293632:12345-0@lo:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778739:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787856701.778748:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787856701.778753:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436294144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778774:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436294144:12345-0@lo:400:kworker.0 Request processed in 21us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778779:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787856701.778787:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787856701.778792:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436294272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778814:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436294272:12345-0@lo:400:kworker.0 Request processed in 22us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778819:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787856701.778854:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436293760 00000100:00100000:2.0:1787856701.778858:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436293760 00000100:00100000:2.0:1787856701.778872:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787856701.778878:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436293760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778903:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436293760:12345-0@lo:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.778909:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787856701.778939:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436293760:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778950:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436294272:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.778981:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8247840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436293632:0@lo:400:kworker.0 00010000:00080000:2.0:1787856701.778992:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8245680 x1874703436294144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856701.779001:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436294144:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.779036:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436293504:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.779045:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436294016:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.779054:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8245e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436293376:0@lo:400:kworker.0 00010000:00080000:2.0:1787856701.779063:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8244f00 x1874703436293888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856701.779070:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8244f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436293888:0@lo:400:kworker.0 00010000:00080000:2.0:1787856701.779079:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c82470c0 x1874703436294400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856701.779086:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436294400:0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.779127:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436293248 00000100:00100000:2.0:1787856701.779130:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436293248 00000100:00100000:2.0:1787856701.779153:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787856701.779159:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436293248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856701.779190:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436293248:12345-0@lo:400:kworker.0 Request processed in 31us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856701.779196:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787856701.779241:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436293248:0@lo:400:kworker.0 00000100:00080000:2.0:1787856701.779288:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856701.779292:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856701.779295:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856701.785087:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436292864 00000100:00100000:3.0:1787856701.785102:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436292864 00000100:00100000:3.0:1787856701.785180:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436293120 00000100:00100000:3.0:1787856701.785185:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436293120 00000100:00100000:3.0:1787856701.785241:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436292992 00000100:00100000:3.0:1787856701.785245:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436292992 00000100:00100000:3.0:1787856701.785266:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856701.785277:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436292864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856701.785314:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856701.785404:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436292864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (7919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856701.785411:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856701.785429:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856701.785435:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436293120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787856701.785450:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856701.785483:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436293120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (7952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856701.785489:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856701.785501:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787856701.785508:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436292992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787856701.785518:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856701.785542:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436292992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (7949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856701.785548:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787856701.785594:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8246d00 x1874703436292864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856701.785614:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436292864:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787856701.785627:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826d2c0 x1874703436292992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856701.785653:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436292992:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787856701.785699:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2c780 x1874703436293120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856701.785712:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436293120:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787856701.786247:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856701.786252:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856702.289562:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856702.289589:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436294528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856702.289665:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856702.289811:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436294528 00000100:00100000:0.0:1787856702.289820:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436294528 00000100:00100000:0.0:1787856702.289887:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787856702.289898:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436294528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856702.289919:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856702.289981:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436294528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856702.289990:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787856702.290203:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826fc00 x1874703436294528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856702.290266:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436294528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856702.353601:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856702.802355:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856702.802381:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436294656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856702.802453:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856702.802495:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436294656 00000100:00100000:2.0:1787856702.802505:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436294656 00000100:00100000:2.0:1787856702.802579:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787856702.802589:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436294656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787856702.802624:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787856702.802692:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436294656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856702.802699:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787856702.802789:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436294656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856702.962061:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856702.965126:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856702.965248:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856702.970635:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426790400 00000100:00100000:2.0:1787856702.970649:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426790400 00000100:00100000:2.0:1787856702.970667:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426790528 00000100:00100000:2.0:1787856702.970671:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426790528 00000100:00100000:2.0:1787856702.970746:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426790656 00000100:00100000:2.0:1787856702.970750:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426790656 00000100:00100000:2.0:1787856702.970779:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:2.0:1787856702.970790:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426790528:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856702.970880:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426790528:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 92us (5764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856702.970906:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:2.0:1787856702.970942:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:2.0:1787856702.970959:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426790656:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856702.970988:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426790656:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (5740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856702.970995:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:2.0:1787856702.971183:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 281 00000100:00100000:2.0:1787856702.971190:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426790400:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856702.971244:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426790400:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 54us (9195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856702.971251:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 281 00000100:00080000:1.0:1787856702.971808:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856702.971814:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856703.314341:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436294784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856703.314419:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856703.314488:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436294784 00000100:00100000:3.0:1787856703.314495:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436294784 00000100:00100000:3.0:1787856703.314534:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787856703.314541:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436294784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856703.314571:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856703.314608:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436294784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856703.314615:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787856703.314652:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436294784:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787856703.316901:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:0.0:1787856703.316909:0:9490:0:(genops.c:885:class_export_put()) final put ffff906601919800/898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:1.0:1787856703.316974:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff906601919800/898e91b3-529b-44bc-a821-726bff6c71d4 for lustre-OST0001 00000020:00000080:1.0:1787856703.317036:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff906601918800 for lustre-OST0001 00000001:00100000:0.0:1787856703.322993:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:0.0:1787856703.323011:0:8402:0:(genops.c:885:class_export_put()) final put ffff90660191f800/898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:3.0:1787856703.324207:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90660191f800/898e91b3-529b-44bc-a821-726bff6c71d4 for lustre-OST0000 00000020:00000080:3.0:1787856703.324282:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90660191b000 for lustre-OST0000 00000001:02000400:3.0:1787856703.344920:0:11100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.81 00010000:00010000:2.0:1787856703.379396:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856704.402198:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856705.425496:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856706.450181:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787856706.496788:0:11197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.81 00000100:00100000:2.0:1787856706.897835:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436295168:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.897929:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856706.898029:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436295168 00000100:00100000:2.0:1787856706.898037:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436295168 00000100:00100000:2.0:1787856706.898082:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787856706.898091:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436295168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898159:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436295168:12345-0@lo:400:kworker.0 Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856706.898167:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787856706.898207:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436295168:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898264:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436295296:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898301:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856706.898357:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436295680:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898379:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856706.898403:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436295296 00000100:00100000:2.0:1787856706.898407:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436295296 00000100:00100000:2.0:1787856706.898432:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436295680 00000100:00100000:2.0:1787856706.898435:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436295680 00000100:00100000:2.0:1787856706.898460:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787856706.898467:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436295296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898497:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436295296:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856706.898503:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787856706.898514:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787856706.898520:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436295680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898547:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436295680:12345-0@lo:400:kworker.0 Request processed in 27us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856706.898553:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787856706.898580:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436295296:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898599:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436295680:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898626:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436295808:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898647:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856706.898674:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436295808 00000100:00100000:2.0:1787856706.898677:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436295808 00000100:00100000:2.0:1787856706.898702:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787856706.898709:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436295808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898751:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436295808:12345-0@lo:400:kworker.0 Request processed in 42us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856706.898756:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1787856706.898781:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9ac000 x1874703436295808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856706.898791:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436295808:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898832:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436296192:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898855:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856706.898878:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436296192 00000100:00100000:2.0:1787856706.898881:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436296192 00000100:00100000:2.0:1787856706.898901:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787856706.898920:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436296192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.898953:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436296192:12345-0@lo:400:kworker.0 Request processed in 46us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856706.898959:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1787856706.898986:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8246d00 x1874703436296192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856706.898995:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436296192:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.899027:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436296320:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.899052:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856706.899085:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436296320 00000100:00100000:2.0:1787856706.899089:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436296320 00000100:00100000:2.0:1787856706.899114:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787856706.899121:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436296320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.899167:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436296320:12345-0@lo:400:kworker.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856706.899174:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787856706.899198:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8246d00 x1874703436296320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856706.899207:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436296320:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.899663:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436294912:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.899703:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856706.899736:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436295424:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.899760:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856706.899779:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436295936:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.899797:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856706.899813:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436296448:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.899836:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856706.899855:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787856706.899862:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436295040:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.899883:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856706.899920:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436295552:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.899944:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856706.899959:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436296064:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.899977:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856706.900003:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436295040 00000100:00100000:0.0:1787856706.900006:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436295040 00000100:00100000:0.0:1787856706.900032:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436296064 00000100:00100000:0.0:1787856706.900035:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436296064 00000100:00100000:0.0:1787856706.900054:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787856706.900060:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436295040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.900096:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436295040:12345-0@lo:400:kworker.0 Request processed in 35us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856706.900102:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787856706.900142:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787856706.900149:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436296064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.900175:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436296064:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856706.900181:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787856706.900197:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436295936 00000100:00100000:0.0:1787856706.900200:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436295936 00000100:00100000:0.0:1787856706.900215:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436296448 00000100:00100000:0.0:1787856706.900244:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436296448 00000100:00100000:0.0:1787856706.900258:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436295552 00000100:00100000:0.0:1787856706.900260:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436295552 00000100:00100000:0.0:1787856706.900272:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787856706.900277:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436295936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.900305:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436295936:12345-0@lo:400:kworker.0 Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856706.900311:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787856706.900321:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787856706.900327:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436296448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.900349:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436296448:12345-0@lo:400:kworker.0 Request processed in 23us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856706.900355:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787856706.900508:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856706.900515:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436295552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.900541:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436295552:12345-0@lo:400:kworker.0 Request processed in 27us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856706.900547:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856706.900576:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436295424 00000100:00100000:0.0:1787856706.900586:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436295424 00000100:00100000:0.0:1787856706.900609:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787856706.900615:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436295424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.900646:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436295424:12345-0@lo:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856706.900652:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787856706.900690:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436295040:0@lo:400:kworker.0 00010000:00080000:0.0:1787856706.900701:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9ad2c0 x1874703436295552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856706.900709:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436295552:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.900717:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436296064:0@lo:400:kworker.0 00000100:00100000:0.0:1787856706.900726:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436295424:0@lo:400:kworker.0 00010000:00080000:0.0:1787856706.900734:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9ac000 x1874703436295936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856706.900741:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436295936:0@lo:400:kworker.0 00010000:00080000:0.0:1787856706.900751:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8246d00 x1874703436296448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856706.900758:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436296448:0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.901024:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436294912 00000100:00100000:2.0:1787856706.901029:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436294912 00000100:00100000:2.0:1787856706.901069:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787856706.901077:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436294912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856706.901116:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436294912:12345-0@lo:400:kworker.0 Request processed in 41us (1412us total) trans 0 rc 0/0 00000100:00080000:1.0:1787856706.901240:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856706.901245:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787856706.901248:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856706.901250:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856706.901987:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787856706.902049:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436294912:0@lo:400:kworker.0 00000100:00100000:1.0:1787856706.907072:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856706.907098:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436296576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856706.907181:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856706.907249:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436296576 00000100:00100000:1.0:1787856706.907256:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436296576 00000100:00100000:1.0:1787856706.907306:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787856706.907315:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436296576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856706.907360:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856706.907404:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436296576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856706.907411:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787856706.907451:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826f840 x1874703436296576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856706.907488:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436296576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856706.913191:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8244f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436296704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856706.913290:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856706.914025:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436296704 00000100:00100000:1.0:1787856706.914035:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436296704 00000100:00100000:1.0:1787856706.914101:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787856706.914112:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436296704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787856706.914147:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856706.914200:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436296704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856706.914208:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787856706.917193:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8244f00 x1874703436296704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856706.917260:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8244f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436296704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856706.918439:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436296832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856706.918512:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856706.918622:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436296832 00000100:00100000:1.0:1787856706.918628:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436296832 00000100:00100000:1.0:1787856706.918689:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787856706.918698:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436296832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856706.918737:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856706.918835:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436296832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856706.918848:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787856706.920100:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2f840 x1874703436296832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856706.920210:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436296832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856707.410507:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856707.410544:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436296960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856707.410617:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856707.410730:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436296960 00000100:00100000:1.0:1787856707.410737:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436296960 00000100:00100000:1.0:1787856707.410793:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787856707.410803:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436296960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856707.410825:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856707.410869:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436296960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856707.410876:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787856707.410975:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826f840 x1874703436296960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856707.410994:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436296960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856707.473386:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856707.922601:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856707.922635:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436297088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856707.922735:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856707.922821:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436297088 00000100:00100000:1.0:1787856707.922832:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436297088 00000100:00100000:1.0:1787856707.923123:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787856707.923136:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436297088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856707.923182:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787856707.923275:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436297088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856707.923283:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787856707.929191:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436297088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856708.066384:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856708.066440:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856708.066484:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856708.066685:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426790784 00000100:00100000:2.0:1787856708.066700:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426790784 00000100:00100000:1.0:1787856708.066840:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426791040 00000100:00100000:1.0:1787856708.066845:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426791040 00000100:00100000:1.0:1787856708.066929:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426790912 00000100:00100000:1.0:1787856708.066933:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426790912 00000100:00100000:1.0:1787856708.066961:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:1.0:1787856708.066973:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426791040:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856708.067685:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:3.0:1787856708.067700:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426790912:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:0.0:1787856708.067905:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856708.067911:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856708.068017:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 283 00000100:00100000:2.0:1787856708.068027:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2400:x1874703426790784:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856708.068516:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426791040:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 1543us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856708.068527:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:3.0:1787856708.068735:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426790912:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 1025us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856708.068744:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:2.0:1787856708.068924:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2400:x1874703426790784:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 898us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856708.068933:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 283 00000100:00100000:2.0:1787856708.434000:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436297216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856708.434108:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856708.434257:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436297216 00000100:00100000:2.0:1787856708.434286:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436297216 00000100:00100000:2.0:1787856708.434350:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787856708.434362:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436297216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856708.434410:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787856708.434471:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436297216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856708.434479:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787856708.435186:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436297216:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856708.498266:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856709.522994:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787856709.568130:0:11295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.81 00010000:00010000:1.0:1787856710.551590:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856711.570426:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787856711.612624:0:11343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 14:51:49 EDT 2026 00000100:00100000:2.0:1787856712.017588:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787856712.017622:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436297344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856712.017726:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856712.018043:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8216580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436297600:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018081:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856712.018103:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8215680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436298112:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018128:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856712.018146:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8215e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436298624:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018168:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856712.018190:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787856712.018196:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436297472:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018250:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856712.018276:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436297984:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018302:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856712.018319:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436298496:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018339:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856712.018372:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436297600 00000100:00100000:3.0:1787856712.018382:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436297600 00000100:00100000:3.0:1787856712.018455:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436298624 00000100:00100000:3.0:1787856712.018459:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436298624 00000100:00100000:3.0:1787856712.018493:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787856712.018502:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436297600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018561:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436297600:12345-0@lo:400:kworker.0 Request processed in 60us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856712.018569:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787856712.018588:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787856712.018594:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7060f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436298624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018622:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7060f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436298624:12345-0@lo:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856712.018628:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787856712.018650:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436297472 00000100:00100000:3.0:1787856712.018654:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436297472 00000100:00100000:3.0:1787856712.018681:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787856712.018688:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436297472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018718:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436297472:12345-0@lo:400:kworker.0 Request processed in 31us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856712.018725:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:3.0:1787856712.018758:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856712.018792:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436297472:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018808:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8216580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436297600:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.018817:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8215e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436298624:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.018967:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436297984 00000100:00100000:2.0:1787856712.018971:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436297984 00000100:00100000:2.0:1787856712.019000:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787856712.019008:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436297984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019048:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436297984:12345-0@lo:400:kworker.0 Request processed in 41us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856712.019055:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787856712.019077:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436297728:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019106:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856712.019126:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436298240:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019151:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856712.019171:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436298752:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019193:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856712.019213:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787856712.019250:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8216940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436297856:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019290:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856712.019311:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436298368:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019333:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856712.019343:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8217840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436298880:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019363:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856712.019390:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436298240 00000100:00100000:2.0:1787856712.019394:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436298240 00000100:00100000:2.0:1787856712.019420:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436298752 00000100:00100000:2.0:1787856712.019424:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436298752 00000100:00100000:2.0:1787856712.019437:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436297856 00000100:00100000:2.0:1787856712.019439:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436297856 00000100:00100000:2.0:1787856712.019450:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436298368 00000100:00100000:2.0:1787856712.019452:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436298368 00000100:00100000:2.0:1787856712.019466:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787856712.019472:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436298240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019508:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436298240:12345-0@lo:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856712.019514:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787856712.019526:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787856712.019532:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8247c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436298752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019562:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8247c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436298752:12345-0@lo:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856712.019568:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787856712.019579:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787856712.019584:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8245e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436297856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019610:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8245e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436297856:12345-0@lo:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856712.019627:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787856712.019640:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787856712.019646:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8244f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436298368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019673:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8244f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436298368:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856712.019679:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787856712.019699:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436297728 00000100:00100000:2.0:1787856712.019703:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436297728 00000100:00100000:2.0:1787856712.019719:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787856712.019724:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436297728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019772:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436297728:12345-0@lo:400:kworker.0 Request processed in 47us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856712.019778:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787856712.019812:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8216940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436297856:0@lo:400:kworker.0 00010000:00080000:2.0:1787856712.019825:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c82152c0 x1874703436298368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856712.019836:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436298368:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019847:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436297728:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.019856:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436298240:0@lo:400:kworker.0 00010000:00080000:2.0:1787856712.019876:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8217c00 x1874703436298752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856712.019885:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436298752:0@lo:400:kworker.0 00000100:00080000:3.0:1787856712.020146:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856712.020153:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856712.020177:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436297984:0@lo:400:kworker.0 00000100:00100000:3.0:1787856712.020197:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856712.020209:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436299008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856712.020284:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856712.020381:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436297344 00000100:00100000:1.0:1787856712.020386:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436297344 00000100:00100000:1.0:1787856712.020435:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436299008 00000100:00100000:1.0:1787856712.020446:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436299008 00000100:00100000:1.0:1787856712.020468:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787856712.020476:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8247840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436297344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856712.020507:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856712.020552:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8247840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436297344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (2828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856712.020558:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787856712.020573:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787856712.020578:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436299008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787856712.020587:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856712.020614:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436299008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856712.020619:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787856712.020662:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8246580 x1874703436299008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856712.020679:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436299008:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787856712.020707:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826ed00 x1874703436297344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856712.020719:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436297344:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787856712.020825:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856712.020963:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436298112 00000100:00100000:0.0:1787856712.020968:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436298112 00000100:00100000:0.0:1787856712.021016:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436298496 00000100:00100000:0.0:1787856712.021020:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436298496 00000100:00100000:0.0:1787856712.021035:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436298880 00000100:00100000:0.0:1787856712.021039:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436298880 00000100:00100000:0.0:1787856712.021051:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856712.021057:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8215a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436298112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856712.021106:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8215a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436298112:12345-0@lo:400:kworker.0 Request processed in 50us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856712.021113:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856712.021129:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787856712.021135:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7061a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436298496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856712.021165:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7061a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436298496:12345-0@lo:400:kworker.0 Request processed in 30us (2824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856712.021184:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787856712.021195:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787856712.021201:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436298880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856712.021258:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436298880:12345-0@lo:400:kworker.0 Request processed in 57us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856712.021264:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787856712.021344:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8214000 x1874703436298496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856712.021355:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436298496:0@lo:400:kworker.0 00010000:00080000:0.0:1787856712.021367:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8215680 x1874703436298112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856712.021376:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8215680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436298112:0@lo:400:kworker.0 00010000:00080000:1.0:1787856712.021581:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8217840 x1874703436298880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856712.021591:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8217840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436298880:0@lo:400:kworker.0 00000100:00100000:2.0:1787856712.021648:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856712.021667:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436299136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856712.021706:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856712.021822:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436299136 00000100:00100000:1.0:1787856712.021827:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436299136 00000100:00100000:1.0:1787856712.021881:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787856712.021888:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436299136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856712.021913:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856712.021958:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436299136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856712.021964:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787856712.022030:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826ed00 x1874703436299136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856712.022044:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436299136:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787856712.022122:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856712.532597:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436299264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856712.532712:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856712.532820:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436299264 00000100:00100000:0.0:1787856712.532829:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436299264 00000100:00100000:0.0:1787856712.532916:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787856712.532928:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436299264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856712.532958:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856712.533011:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436299264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856712.533019:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787856712.533089:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2cf00 x1874703436299264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856712.533137:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436299264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856712.612580:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856713.050714:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856713.050745:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436299392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856713.050861:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856713.051037:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436299392 00000100:00100000:3.0:1787856713.051047:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436299392 00000100:00100000:3.0:1787856713.051104:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787856713.051116:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436299392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856713.051160:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856713.051264:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436299392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856713.051402:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787856713.051461:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436299392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856713.180714:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856713.180770:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856713.180844:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426791168 00000100:00100000:2.0:1787856713.180874:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426791168 00000100:00100000:2.0:1787856713.180947:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 285 00000100:00100000:2.0:1787856713.180961:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2402:x1874703426791168:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856713.181082:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2402:x1874703426791168:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 123us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856713.181091:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 285 00000100:00100000:0.0:1787856713.182054:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856713.193375:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426791424 00000100:00100000:3.0:1787856713.193405:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426791424 00000100:00100000:3.0:1787856713.193588:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426791296 00000100:00100000:3.0:1787856713.193593:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426791296 00000100:00100000:1.0:1787856713.193648:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:1.0:1787856713.193663:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426791424:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856713.193785:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426791424:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 124us (13013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856713.193793:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00080000:0.0:1787856713.199469:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856713.199554:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856713.200001:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:3.0:1787856713.200020:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426791296:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856713.200921:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426791296:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 901us (18876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856713.200932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:2.0:1787856713.553595:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436299520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856713.553828:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856713.553998:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436299520 00000100:00100000:1.0:1787856713.554009:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436299520 00000100:00100000:1.0:1787856713.554091:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787856713.554103:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436299520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856713.554150:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856713.567610:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436299520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13492us (13765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856713.567630:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787856713.568211:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436299520:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856713.620278:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856714.642981:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856715.665974:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856716.692332:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856717.137413:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8217840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436300160:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.137451:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436299776:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.141778:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.142681:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436299648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856717.142757:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.142786:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8215680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436300288:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.142955:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.142981:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436300800:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143004:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143025:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8215e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436301312:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143051:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143085:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787856717.143092:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436300672:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143135:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8216940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436301184:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143154:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143189:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436299904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856717.143212:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143254:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436300416:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143283:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143305:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436300928:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143329:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143347:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8216580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436301440:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143368:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143388:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787856717.143395:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436300032:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143417:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.143436:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436300544:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.143470:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856717.143693:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436300288 00000100:00100000:2.0:1787856717.143704:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436300288 00000100:00100000:2.0:1787856717.143759:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436300800 00000100:00100000:2.0:1787856717.143763:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436300800 00000100:00100000:2.0:1787856717.143936:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436300672 00000100:00100000:3.0:1787856717.143982:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436301056:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.144012:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856717.144024:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436301568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856717.144109:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787856717.144143:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856717.144160:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436300416 00000100:00100000:1.0:1787856717.144164:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436300416 00000100:00100000:1.0:1787856717.144188:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436300160 00000100:00100000:1.0:1787856717.144191:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436300160 00000100:00100000:1.0:1787856717.144236:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787856717.144246:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436300416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.144311:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436300416:12345-0@lo:400:kworker.0 Request processed in 66us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.144318:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787856717.144337:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787856717.144343:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436300160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.144372:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436300160:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.144457:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787856717.144582:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8217840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436300160:0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.144662:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436301184 00000100:00100000:1.0:1787856717.144667:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436301184 00000100:00100000:1.0:1787856717.144694:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436300032 00000100:00100000:1.0:1787856717.144697:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436300032 00000100:00100000:1.0:1787856717.144707:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436301056 00000100:00100000:1.0:1787856717.144709:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436301056 00000100:00100000:1.0:1787856717.144722:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787856717.144728:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436300288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.144772:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436300288:12345-0@lo:400:kworker.0 Request processed in 43us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.144779:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787856717.144792:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787856717.144798:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436300800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.144840:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436300800:12345-0@lo:400:kworker.0 Request processed in 43us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.144858:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787856717.144871:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787856717.144877:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436301184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.144910:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436301184:12345-0@lo:400:kworker.0 Request processed in 34us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.144917:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787856717.144927:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787856717.144934:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7926d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436300032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.144964:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7926d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436300032:12345-0@lo:400:kworker.0 Request processed in 31us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.145144:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787856717.145157:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787856717.145163:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436301056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.145195:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436301056:12345-0@lo:400:kworker.0 Request processed in 32us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.145200:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787856717.145260:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436301312 00000100:00100000:1.0:1787856717.145265:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436301312 00000100:00100000:1.0:1787856717.145288:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436300928 00000100:00100000:1.0:1787856717.145290:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436300928 00000100:00100000:1.0:1787856717.145303:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436301440 00000100:00100000:1.0:1787856717.145305:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436301440 00000100:00100000:1.0:1787856717.145316:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436300544 00000100:00100000:1.0:1787856717.145318:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436300544 00000100:00100000:1.0:1787856717.145331:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787856717.145337:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436301312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.145603:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436301312:12345-0@lo:400:kworker.0 Request processed in 265us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.145611:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787856717.145623:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787856717.145631:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7926940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436300928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.145662:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7926940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436300928:12345-0@lo:400:kworker.0 Request processed in 33us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.145668:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787856717.145679:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787856717.145685:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436301440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.145716:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436301440:12345-0@lo:400:kworker.0 Request processed in 31us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.145722:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787856717.145732:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787856717.145739:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436300544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856717.145757:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436300672 00000100:00100000:2.0:1787856717.145820:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787856717.145828:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436300672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856717.145832:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436300544:12345-0@lo:400:kworker.0 Request processed in 94us (2362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.145839:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787856717.145864:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436300672:12345-0@lo:400:kworker.0 Request processed in 38us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.145870:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436299648 00000100:00100000:2.0:1787856717.145871:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787856717.145874:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436299648 00000100:00100000:1.0:1787856717.145899:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436299904 00000100:00100000:1.0:1787856717.145903:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436299904 00000100:00100000:1.0:1787856717.145914:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787856717.145919:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787856717.145920:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8214b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436299648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856717.145926:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436299904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856717.145946:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787856717.145946:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856717.145980:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436299904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856717.145986:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787856717.146111:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8214b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436299648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 189us (3353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856717.146126:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787856717.146147:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856717.146152:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787856717.146155:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856717.146157:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856717.146420:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436299776 00000100:00100000:0.0:1787856717.146425:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436299776 00000100:00100000:3.0:1787856717.146567:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787856717.146644:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826cf00 x1874703436299904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.146668:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436299904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856717.146685:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436300416:0@lo:400:kworker.0 00010000:00080000:3.0:1787856717.146696:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8214780 x1874703436300928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.146705:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436300928:0@lo:400:kworker.0 00010000:00080000:3.0:1787856717.146716:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8216580 x1874703436301440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.146723:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8216580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436301440:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.146759:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436300032:0@lo:400:kworker.0 00010000:00080000:3.0:1787856717.146772:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8214f00 x1874703436300544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.146780:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436300544:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.146971:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436301056:0@lo:400:kworker.0 00000100:00100000:3.0:1787856717.147022:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436300672:0@lo:400:kworker.0 00010000:00080000:3.0:1787856717.147052:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8216940 x1874703436301184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.147061:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8216940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436301184:0@lo:400:kworker.0 00010000:00080000:3.0:1787856717.147074:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826e940 x1874703436299648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.147086:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436299648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856717.147100:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8215680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436300288:0@lo:400:kworker.0 00010000:00080000:3.0:1787856717.147113:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c82161c0 x1874703436300800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.147122:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436300800:0@lo:400:kworker.0 00010000:00080000:3.0:1787856717.147134:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8215e00 x1874703436301312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.147141:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8215e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436301312:0@lo:400:kworker.0 00000100:00100000:0.0:1787856717.147433:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436301568 00000100:00100000:0.0:1787856717.147439:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436301568 00000100:00100000:0.0:1787856717.147490:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787856717.147500:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436301568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856717.147526:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856717.147593:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436301568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856717.147601:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787856717.147835:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9ad2c0 x1874703436301568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856717.147851:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436301568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856717.148520:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787856717.148530:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436299776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856717.148606:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436299776:12345-0@lo:400:kworker.0 Request processed in 76us (6837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856717.148624:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787856717.149109:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436299776:0@lo:400:kworker.0 00000100:00100000:2.0:1787856717.649395:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436301696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856717.649510:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856717.649610:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436301696 00000100:00100000:2.0:1787856717.649620:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436301696 00000100:00100000:2.0:1787856717.649683:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787856717.649693:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7beda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436301696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856717.649722:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856717.649774:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7beda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436301696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856717.649782:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787856717.649917:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7bee940 x1874703436301696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856717.649942:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436301696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787856717.713475:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856718.162393:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856718.162425:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436301824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856718.162526:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856718.162620:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436301824 00000100:00100000:3.0:1787856718.162650:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436301824 00000100:00100000:3.0:1787856718.162711:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787856718.162721:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7062d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436301824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856718.162766:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856718.162834:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7062d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436301824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856718.162842:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787856718.162895:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436301824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856718.313080:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856718.313127:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856718.313157:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856718.313196:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426791552 00000100:00100000:2.0:1787856718.313210:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426791552 00000100:00100000:2.0:1787856718.313295:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 287 00000100:00100000:2.0:1787856718.313318:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2399:x1874703426791552:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856718.313416:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2399:x1874703426791552:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 101us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856718.313426:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 287 00000100:00100000:2.0:1787856718.313469:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426791808 00000100:00100000:2.0:1787856718.313473:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426791808 00000100:00100000:2.0:1787856718.313514:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426791680 00000100:00100000:2.0:1787856718.313517:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426791680 00000100:00100000:2.0:1787856718.313543:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:2.0:1787856718.313550:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426791808:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856718.313589:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426791808:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856718.313595:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:2.0:1787856718.313608:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:2.0:1787856718.313613:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426791680:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856718.313640:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426791680:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856718.313646:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00080000:2.0:1787856718.313702:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856718.313707:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856718.690605:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436301952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856718.690707:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856718.695631:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436301952 00000100:00100000:1.0:1787856718.695654:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436301952 00000100:00100000:1.0:1787856718.695740:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787856718.695752:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436301952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856718.695814:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856718.695938:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436301952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856718.695946:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787856718.696135:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436301952:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856718.738001:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856719.773642:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856720.786515:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856721.813454:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856722.258492:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436302080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856722.258592:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856722.258696:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436302080 00000100:00100000:3.0:1787856722.258705:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436302080 00000100:00100000:3.0:1787856722.258847:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787856722.258860:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436302080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856722.258900:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856722.258955:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436302080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856722.258962:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787856722.259010:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7bec3c0 x1874703436302080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856722.259028:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436302080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856722.259139:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436302208:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259165:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856722.259183:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436302720:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259256:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856722.259283:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436303232:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259301:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856722.259316:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787856722.259320:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436302336:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259335:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856722.259347:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436302848:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259366:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856722.259382:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436303360:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259401:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856722.259429:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436302208 00000100:00100000:3.0:1787856722.259432:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436302208 00000100:00100000:3.0:1787856722.259452:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787856722.259457:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436302208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259482:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436302208:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856722.259487:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787856722.259506:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436303232 00000100:00100000:3.0:1787856722.259509:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436303232 00000100:00100000:3.0:1787856722.259526:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436302848 00000100:00100000:3.0:1787856722.259527:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436302848 00000100:00100000:3.0:1787856722.259542:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856722.259546:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436303232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259565:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436303232:12345-0@lo:400:kworker.0 Request processed in 20us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856722.259569:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856722.259583:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856722.259587:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436302848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259603:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436302848:12345-0@lo:400:kworker.0 Request processed in 17us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856722.259607:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856722.259619:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436302336 00000100:00100000:3.0:1787856722.259622:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436302336 00000100:00100000:3.0:1787856722.259637:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436303360 00000100:00100000:3.0:1787856722.259639:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436303360 00000100:00100000:3.0:1787856722.259649:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787856722.259653:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436302336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259678:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436302336:12345-0@lo:400:kworker.0 Request processed in 23us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856722.259683:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787856722.259695:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787856722.259701:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436303360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.259726:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436303360:12345-0@lo:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856722.259732:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787856722.259898:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856722.259903:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787856722.259905:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856722.259925:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856722.259933:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436303744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856722.259965:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856722.259989:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436303744 00000100:00100000:2.0:1787856722.259991:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436303744 00000100:00100000:2.0:1787856722.260015:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787856722.260019:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436303744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787856722.260030:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856722.260051:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436303744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856722.260055:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787856722.260066:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787856722.260079:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5f480 x1874703436303744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856722.260091:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436303744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856722.260200:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436302464:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260254:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856722.260274:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436302976:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260294:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856722.260305:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436303488:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260318:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856722.260331:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787856722.260335:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436302592:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260349:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856722.260361:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436303104:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260398:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856722.260414:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436303616:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260430:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856722.260534:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436303616 00000100:00100000:0.0:1787856722.260537:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436303616 00000100:00100000:0.0:1787856722.260555:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787856722.260559:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436303616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260583:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436303616:12345-0@lo:400:kworker.0 Request processed in 24us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856722.260593:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787856722.260607:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436302976 00000100:00100000:0.0:1787856722.260610:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436302976 00000100:00100000:0.0:1787856722.260623:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436303488 00000100:00100000:0.0:1787856722.260624:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436303488 00000100:00100000:0.0:1787856722.260632:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436302592 00000100:00100000:0.0:1787856722.260634:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436302592 00000100:00100000:0.0:1787856722.260640:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436303104 00000100:00100000:0.0:1787856722.260641:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436303104 00000100:00100000:0.0:1787856722.260649:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787856722.260652:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436302976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260679:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436302976:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856722.260686:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787856722.260696:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787856722.260702:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436303488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.260728:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436303488:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856722.260735:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787856722.260865:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436302720 00000100:00100000:2.0:1787856722.260869:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436302720 00000100:00100000:2.0:1787856722.260885:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436302464 00000100:00100000:2.0:1787856722.260887:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436302464 00000100:00100000:2.0:1787856722.260895:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787856722.260899:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436302720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856722.260928:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436302720:12345-0@lo:400:kworker.0 Request processed in 29us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856722.260931:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787856722.260938:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787856722.260942:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436302464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856722.260955:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436302464:12345-0@lo:400:kworker.0 Request processed in 13us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856722.260966:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787856722.260996:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787856722.261001:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436302592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.261022:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436302592:12345-0@lo:400:kworker.0 Request processed in 22us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856722.262924:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436302336:0@lo:400:kworker.0 00010000:00080000:3.0:1787856722.262951:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7b2bc00 x1874703436302848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856722.262964:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436302848:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.262978:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436303360:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.262990:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436302208:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.263024:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436302720:0@lo:400:kworker.0 00010000:00080000:3.0:1787856722.263039:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6bc00 x1874703436303232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856722.263049:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436303232:0@lo:400:kworker.0 00000100:00100000:3.0:1787856722.263101:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856722.263114:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436303872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856722.263184:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856722.265076:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787856722.265115:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436303872 00000100:00100000:2.0:1787856722.265123:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436303872 00000100:00100000:2.0:1787856722.265182:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787856722.265191:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436303872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856722.265250:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856722.265347:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436303872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856722.265354:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787856722.265385:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856722.265392:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787856722.265436:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9ad2c0 x1874703436303872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856722.265462:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436303872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856722.265494:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436303104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856722.265538:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436303104:12345-0@lo:400:kworker.0 Request processed in 449us (5139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856722.265545:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787856722.269538:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787856722.269649:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436302592:0@lo:400:kworker.0 00010000:00080000:0.0:1787856722.269673:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d69e00 x1874703436303104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856722.269716:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436303104:0@lo:400:kworker.0 00010000:00080000:0.0:1787856722.269735:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7abb0c0 x1874703436303616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856722.269894:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436303616:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.269917:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436302464:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.270054:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436302976:0@lo:400:kworker.0 00010000:00080000:0.0:1787856722.270074:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b480 x1874703436303488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856722.270083:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436303488:0@lo:400:kworker.0 00000100:00100000:0.0:1787856722.769590:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436304000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856722.769709:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856722.769873:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436304000 00000100:00100000:2.0:1787856722.769885:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436304000 00000100:00100000:2.0:1787856722.769953:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787856722.769964:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436304000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856722.769993:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856722.770056:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436304000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856722.770083:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787856722.770278:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5f480 x1874703436304000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856722.770300:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436304000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787856722.833872:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856723.281403:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436304128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856723.281521:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856723.281607:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436304128 00000100:00100000:3.0:1787856723.281616:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436304128 00000100:00100000:3.0:1787856723.281680:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787856723.281691:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d03ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436304128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856723.281735:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856723.281801:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d03ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436304128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856723.281809:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787856723.281852:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436304128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856723.421942:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856723.424146:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856723.424183:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856723.424252:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426791936 00000100:00100000:1.0:1787856723.424264:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426791936 00000100:00100000:1.0:1787856723.424331:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 289 00000100:00100000:1.0:1787856723.424343:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2399:x1874703426791936:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856723.424438:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2399:x1874703426791936:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856723.424448:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 289 00000100:00100000:2.0:1787856723.424793:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426792064 00000100:00100000:2.0:1787856723.424799:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426792064 00000100:00100000:2.0:1787856723.424850:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426792192 00000100:00100000:2.0:1787856723.424853:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426792192 00000100:00100000:2.0:1787856723.424882:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:2.0:1787856723.424890:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426792064:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856723.424928:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426792064:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856723.424935:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:2.0:1787856723.425853:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:2.0:1787856723.425869:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426792192:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856723.425924:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426792192:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 61us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856723.425932:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00080000:2.0:1787856723.426190:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856723.426197:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856723.794018:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856723.794050:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436304256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856723.794151:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856723.794275:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436304256 00000100:00100000:0.0:1787856723.794285:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436304256 00000100:00100000:0.0:1787856723.794350:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787856723.794361:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436304256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787856723.794407:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787856723.794465:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436304256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856723.794473:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787856723.794530:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436304256:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856723.858825:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856724.881393:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856725.909487:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856726.931417:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856727.377621:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436304384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856727.377621:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436304512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856727.377995:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436304768:0@lo:400:kworker.0 00000100:00100000:1.0:1787856727.381463:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436304640:0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.382657:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856727.382785:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436304896:0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.382832:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856727.382856:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436305408:0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.382882:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856727.382901:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436305920:0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.383320:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856727.383370:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856727.383378:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436306304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856727.383409:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856727.383533:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436304384 00000100:00100000:3.0:1787856727.383543:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436304384 00000100:00100000:3.0:1787856727.383611:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436306304 00000100:00100000:3.0:1787856727.383614:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436306304 00000100:00100000:3.0:1787856727.383633:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787856727.383643:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436304384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856727.383682:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856727.383745:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436304384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856727.383753:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787856727.383773:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787856727.383779:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436306304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787856727.383789:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856727.383812:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436306304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856727.383818:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787856727.383838:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436304896 00000100:00100000:3.0:1787856727.383842:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436304896 00000100:00100000:3.0:1787856727.383869:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787856727.383876:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436304896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.383994:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436304896:12345-0@lo:400:kworker.0 Request processed in 52us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856727.384002:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787856727.384165:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436305408 00000100:00100000:3.0:1787856727.384181:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436305408 00000100:00100000:3.0:1787856727.384238:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436305920 00000100:00100000:3.0:1787856727.384241:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436305920 00000100:00100000:3.0:1787856727.384263:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787856727.384270:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436305408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.384306:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436305408:12345-0@lo:400:kworker.0 Request processed in 37us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856727.384312:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787856727.384323:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787856727.384329:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436305920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.384355:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436305920:12345-0@lo:400:kworker.0 Request processed in 28us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856727.384361:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787856727.384382:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856727.384387:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856727.384389:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787856727.384548:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826fc00 x1874703436306304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856727.384573:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436306304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856727.384593:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436304896:0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.384606:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436305408:0@lo:400:kworker.0 00010000:00080000:3.0:1787856727.384617:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9aed00 x1874703436305920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856727.384625:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436305920:0@lo:400:kworker.0 00010000:00080000:3.0:1787856727.384636:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b0c0 x1874703436304384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856727.384656:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436304384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856727.388210:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856727.388295:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436305280:0@lo:400:kworker.0 00000100:00100000:2.0:1787856727.388335:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856727.388384:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436305280 00000100:00100000:2.0:1787856727.388393:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436305280 00000100:00100000:2.0:1787856727.388464:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787856727.388494:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436305280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856727.388557:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436305280:12345-0@lo:400:kworker.0 Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856727.388565:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787856727.388595:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787856727.388634:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5f480 x1874703436305280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856727.390828:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856727.390917:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436304512 00000100:00100000:0.0:1787856727.390928:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436304512 00000100:00100000:0.0:1787856727.391000:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787856727.391010:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436304512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856727.391050:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856727.391105:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436304512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856727.391114:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1787856727.391170:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ede00 x1874703436304512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856727.391195:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436304512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856727.391243:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436305024:0@lo:400:kworker.0 00000100:00100000:0.0:1787856727.391282:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856727.391333:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436304768 00000100:00100000:0.0:1787856727.391338:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436304768 00000100:00100000:0.0:1787856727.391367:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436305024 00000100:00100000:0.0:1787856727.391370:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436305024 00000100:00100000:0.0:1787856727.391393:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787856727.391398:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436304768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856727.391433:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436304768:12345-0@lo:400:kworker.0 Request processed in 35us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856727.391440:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787856727.391451:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787856727.391456:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436305024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856727.391482:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436305024:12345-0@lo:400:kworker.0 Request processed in 26us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856727.391487:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787856727.391515:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436305024:0@lo:400:kworker.0 00000100:00100000:0.0:1787856727.391522:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436305536:0@lo:400:kworker.0 00000100:00100000:0.0:1787856727.391544:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856727.391562:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436306048:0@lo:400:kworker.0 00000100:00100000:0.0:1787856727.391586:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856727.391611:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436306048 00000100:00100000:0.0:1787856727.391614:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436306048 00000100:00100000:0.0:1787856727.391643:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787856727.391732:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436306048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856727.391769:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436306048:12345-0@lo:400:kworker.0 Request processed in 120us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856727.391776:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787856727.391820:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9ad2c0 x1874703436306048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856727.391830:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436306048:0@lo:400:kworker.0 00000100:00080000:0.0:1787856727.391891:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856727.392861:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436305536 00000100:00100000:3.0:1787856727.392871:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436305536 00000100:00100000:3.0:1787856727.392950:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787856727.392960:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436305536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.393039:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436305536:12345-0@lo:400:kworker.0 Request processed in 81us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856727.393047:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787856727.393266:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436305280:0@lo:400:kworker.0 00000100:00100000:2.0:1787856727.393282:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436305792:0@lo:400:kworker.0 00000100:00100000:2.0:1787856727.393321:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856727.393388:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436304768:0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.394263:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436305792 00000100:00100000:3.0:1787856727.394272:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436305792 00000100:00100000:3.0:1787856727.394339:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787856727.394348:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436305792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.394412:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436305792:12345-0@lo:400:kworker.0 Request processed in 65us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856727.394420:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1787856727.394753:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856727.394759:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787856727.394799:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9ada40 x1874703436305536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856727.394813:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436305536:0@lo:400:kworker.0 00000100:00100000:2.0:1787856727.395870:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436305792:0@lo:400:kworker.0 00000100:00100000:1.0:1787856727.396036:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856727.396135:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436305152:0@lo:400:kworker.0 00000100:00100000:1.0:1787856727.396194:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856727.396243:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436305664:0@lo:400:kworker.0 00000100:00100000:1.0:1787856727.396272:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856727.396302:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436306176:0@lo:400:kworker.0 00000100:00100000:1.0:1787856727.396324:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856727.396368:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436305664 00000100:00100000:1.0:1787856727.396375:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436305664 00000100:00100000:1.0:1787856727.396424:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436306176 00000100:00100000:1.0:1787856727.396427:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436306176 00000100:00100000:1.0:1787856727.396451:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787856727.396461:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436305664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856727.396515:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436305664:12345-0@lo:400:kworker.0 Request processed in 56us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856727.396523:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787856727.396539:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787856727.396545:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436306176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856727.396571:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436306176:12345-0@lo:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856727.396577:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787856727.396614:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe9acf00 x1874703436305664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856727.396626:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436305664:0@lo:400:kworker.0 00010000:00080000:1.0:1787856727.396637:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008d8000 x1874703436306176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856727.396646:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436306176:0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.396827:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436305152 00000100:00100000:3.0:1787856727.396831:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436305152 00000100:00100000:3.0:1787856727.396861:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787856727.396868:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436305152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856727.396906:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436305152:12345-0@lo:400:kworker.0 Request processed in 39us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856727.396912:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787856727.396990:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436305152:0@lo:400:kworker.0 00000100:00100000:2.0:1787856727.405056:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436304640 00000100:00100000:2.0:1787856727.405079:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436304640 00000100:00100000:2.0:1787856727.405171:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787856727.405185:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436304640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856727.405325:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436304640:12345-0@lo:400:kworker.0 Request processed in 143us (9289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856727.405333:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787856727.405744:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436304640:0@lo:400:kworker.0 00000100:00100000:0.0:1787856727.895360:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856727.895402:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436306432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856727.895499:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856727.896052:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436306432 00000100:00100000:1.0:1787856727.896062:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436306432 00000100:00100000:1.0:1787856727.896134:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787856727.896145:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436306432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856727.896176:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856727.896262:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436306432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856727.896270:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1787856727.896630:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008da580 x1874703436306432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856727.896654:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436306432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856727.957296:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856728.402391:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856728.402426:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436306560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856728.402532:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856728.402717:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436306560 00000100:00100000:3.0:1787856728.402729:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436306560 00000100:00100000:3.0:1787856728.402805:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787856728.402818:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436306560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856728.402886:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856728.402953:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436306560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856728.402961:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787856728.403195:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436306560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856728.544589:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856728.544639:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856728.544680:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856728.544788:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426792320 00000100:00100000:3.0:1787856728.544801:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426792320 00000100:00100000:3.0:1787856728.544866:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 291 00000100:00100000:3.0:1787856728.544876:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426792320:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856728.544977:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2401:x1874703426792320:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 102us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856728.544986:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 291 00000100:00100000:3.0:1787856728.545134:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426792576 00000100:00100000:3.0:1787856728.545137:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426792576 00000100:00100000:3.0:1787856728.545173:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426792448 00000100:00100000:3.0:1787856728.545175:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426792448 00000100:00100000:3.0:1787856728.545194:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:3.0:1787856728.545200:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426792576:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856728.545260:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426792576:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 60us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856728.545266:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:3.0:1787856728.545277:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:3.0:1787856728.545282:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426792448:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856728.545302:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426792448:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 20us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856728.545307:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00080000:0.0:1787856728.546413:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856728.546423:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856728.913418:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856728.913444:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436306688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856728.913536:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856728.913611:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436306688 00000100:00100000:0.0:1787856728.913618:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436306688 00000100:00100000:0.0:1787856728.913665:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787856728.913673:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436306688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787856728.913724:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787856728.913778:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436306688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856728.913814:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787856728.913873:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436306688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856728.995902:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787856729.520691:0:11972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:52:07 (1787856727) === 00010000:00010000:0.0:1787856730.001755:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856730.083095:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.083264:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426792704 00000100:00100000:1.0:1787856730.083277:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426792704 00000100:00100000:1.0:1787856730.083354:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 292 00000100:00100000:1.0:1787856730.083367:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:8722:x1874703426792704:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787856730.083391:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856730.083416:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601938e00/0xc25410d92a3c3b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5e4d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856730.083468:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601938e00/0xc25410d92a3c3b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e4d expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856730.083481:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601938e00/0xc25410d92a3c3b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e4d expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856730.083514:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938e00, rc 0) 00000100:00100000:1.0:1787856730.083602:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8722:x1874703426792704:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 237us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856730.083610:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 292 00000100:00100000:3.0:1787856730.097886:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.098156:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426792832 00000100:00100000:2.0:1787856730.098170:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426792832 00000100:00100000:2.0:1787856730.098307:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 293 00000100:00100000:2.0:1787856730.098319:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8722:x1874703426792832:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787856730.098545:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8722:x1874703426792832:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 227us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.098553:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 293 00000100:00100000:2.0:1787856730.102340:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856730.102493:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426792960 00000100:00100000:3.0:1787856730.102506:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426792960 00000100:00100000:3.0:1787856730.102578:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 294 00000100:00100000:3.0:1787856730.102591:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8722:x1874703426792960:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787856730.102818:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8722:x1874703426792960:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 228us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856730.102827:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 294 00000100:00100000:1.0:1787856730.111011:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.111390:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426793088 00000100:00100000:2.0:1787856730.111404:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426793088 00000100:00100000:2.0:1787856730.111474:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 295 00000100:00100000:2.0:1787856730.111486:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8726:x1874703426793088:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856730.111744:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8726:x1874703426793088:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 259us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.111758:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 295 00000100:00100000:2.0:1787856730.148260:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.148608:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426793216 00000100:00100000:1.0:1787856730.148623:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426793216 00000100:00100000:1.0:1787856730.148710:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 296 00000100:00100000:1.0:1787856730.148722:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8726:x1874703426793216:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787856730.149090:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8726:x1874703426793216:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 368us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856730.149100:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 296 00000100:00100000:3.0:1787856730.163459:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.168254:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426793344 00000100:00100000:2.0:1787856730.168276:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426793344 00000100:00100000:2.0:1787856730.168370:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 297 00000100:00100000:2.0:1787856730.168383:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8726:x1874703426793344:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856730.168634:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8726:x1874703426793344:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 252us (5188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.168644:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 297 00000100:00100000:0.0:1787856730.179614:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.179738:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426793472 00000100:00100000:2.0:1787856730.179865:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426793472 00000100:00100000:2.0:1787856730.180013:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 298 00000100:00100000:2.0:1787856730.180025:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+11:8722:x1874703426793472:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787856730.180051:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856730.180076:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076bc00/0xc25410d92a3c3b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5e7e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856730.180115:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076bc00/0xc25410d92a3c3b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e7e expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856730.180130:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076bc00/0xc25410d92a3c3b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e7e expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856730.180141:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076bc00, rc 0) 00000100:00100000:2.0:1787856730.180257:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+12:8722:x1874703426793472:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 234us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.180265:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 298 00000100:00100000:3.0:1787856730.183670:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.184406:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426793600 00000100:00100000:2.0:1787856730.184421:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426793600 00000100:00100000:2.0:1787856730.184511:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 299 00000100:00100000:2.0:1787856730.184528:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+12:8722:x1874703426793600:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787856730.184567:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787856730.184603:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787856730.184607:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787856730.184612:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787856730.184615:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787856730.184618:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787856730.200495:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+12:8722:x1874703426793600:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 15955us (16819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.200530:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 299 00000100:00100000:1.0:1787856730.208585:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.208721:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426793728 00000100:00100000:2.0:1787856730.208736:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426793728 00000100:00100000:2.0:1787856730.208818:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 300 00000100:00100000:2.0:1787856730.208832:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+12:8722:x1874703426793728:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787856730.208856:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856730.208880:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5e85 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856730.208929:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856730.208943:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856730.208955:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076ba00, rc 0) 00000100:00100000:2.0:1787856730.209275:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8722:x1874703426793728:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 444us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.209285:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 300 00000100:00100000:3.0:1787856730.215175:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.215542:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426793856 00000100:00100000:2.0:1787856730.215554:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426793856 00000100:00100000:2.0:1787856730.215627:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 301 00000100:00100000:2.0:1787856730.215638:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8722:x1874703426793856:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787856730.215855:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8722:x1874703426793856:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 218us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.215864:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 301 00000100:00100000:0.0:1787856730.218506:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.218662:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426793984 00000100:00100000:2.0:1787856730.218684:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426793984 00000100:00100000:2.0:1787856730.218760:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 302 00000100:00100000:2.0:1787856730.218771:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8722:x1874703426793984:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787856730.218986:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8722:x1874703426793984:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 215us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.218995:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 302 00000100:00100000:1.0:1787856730.223821:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856730.223951:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426794112 00000100:00100000:0.0:1787856730.223964:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426794112 00000100:00100000:0.0:1787856730.224042:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 303 00000100:00100000:0.0:1787856730.224054:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8732:x1874703426794112:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787856730.224296:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8732:x1874703426794112:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 242us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856730.224305:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 303 00000100:00100000:0.0:1787856730.229499:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.229658:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426794240 00000100:00100000:2.0:1787856730.229681:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426794240 00000100:00100000:2.0:1787856730.229763:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 304 00000100:00100000:2.0:1787856730.229775:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8732:x1874703426794240:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856730.230045:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:8732:x1874703426794240:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 272us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.230054:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 304 00000100:00100000:1.0:1787856730.257722:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.257791:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.257822:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.257862:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856730.258098:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426794368 00000100:00100000:0.0:1787856730.258113:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426794368 00000100:00100000:0.0:1787856730.258159:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426794624 00000100:00100000:0.0:1787856730.258163:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426794624 00000100:00100000:0.0:1787856730.258171:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426795008 00000100:00100000:0.0:1787856730.258174:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426795008 00000100:00100000:0.0:1787856730.258250:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426795136 00000100:00100000:0.0:1787856730.258254:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426795136 00000100:00100000:0.0:1787856730.258279:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:0.0:1787856730.258291:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426795008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856730.258394:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426795008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 105us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856730.258425:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:0.0:1787856730.258463:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00100000:0.0:1787856730.258470:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426795136:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856730.258499:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426795136:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856730.258505:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00100000:0.0:1787856730.258517:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1787856730.258522:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874703426794368:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787856730.258550:0:8909:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb@192.168.202.6@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1787856730.258593:0:8909:0:(genops.c:1385:class_connect()) connect: client fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb, cookie 0xc25410d92a3c3b53 00000004:00100000:0.0:1787856730.258628:0:8909:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1787856730.258790:0:8909:0:(import.c:65:import_set_state_nolock()) ffff9064c802a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856730.258824:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2398:x1874703426794368:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 300us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856730.258831:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1787856730.258848:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:0.0:1787856730.258852:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874703426794624:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787856730.258866:0:8909:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb@192.168.202.6@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1787856730.258890:0:8909:0:(genops.c:1385:class_connect()) connect: client fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb, cookie 0xc25410d92a3c3b5a 00000100:00080000:3.0:1787856730.259196:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856730.259201:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00100000:0.0:1787856730.259590:0:8909:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1787856730.259698:0:8909:0:(import.c:65:import_set_state_nolock()) ffff9064c802b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856730.259777:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2398:x1874703426794624:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 922us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856730.259803:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1787856730.274744:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856730.274965:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426794496 00000100:00100000:3.0:1787856730.274978:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426794496 00000100:00100000:3.0:1787856730.275080:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:3.0:1787856730.275092:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:0:x1874703426794496:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787856730.275143:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856730.275298:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:0:x1874703426794496:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 208us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856730.275307:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00080000:0.0:1787856730.276705:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856730.289300:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.289349:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856730.289450:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426794880 00000100:00100000:0.0:1787856730.289464:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426794880 00000100:00100000:0.0:1787856730.289542:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426794752 00000100:00100000:0.0:1787856730.289546:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426794752 00000100:00100000:0.0:1787856730.289604:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1787856730.289616:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:8722:x1874703426794880:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787856730.289662:0:8909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787856730.289774:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:8722:x1874703426794880:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 159us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856730.289783:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1787856730.289807:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1787856730.289814:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:0:x1874703426794752:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787856730.289840:0:8909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856730.289893:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:0:x1874703426794752:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 79us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856730.289900:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00080000:1.0:1787856730.290143:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856730.295088:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.295265:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426795264 00000100:00100000:1.0:1787856730.295278:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426795264 00000100:00100000:1.0:1787856730.295357:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1787856730.295370:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:8722:x1874703426795264:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787856730.295516:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:8722:x1874703426795264:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 148us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856730.295526:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1787856730.300794:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.300851:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856730.300889:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856730.301100:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426795392 00000100:00100000:3.0:1787856730.301113:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426795392 00000100:00100000:3.0:1787856730.301163:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426795520 00000100:00100000:3.0:1787856730.301167:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426795520 00000100:00100000:3.0:1787856730.301193:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1787856730.301204:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874703426795392:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787856730.301304:0:8407:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb@192.168.202.6@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1787856730.301344:0:8407:0:(genops.c:1385:class_connect()) connect: client fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb, cookie 0xc25410d92a3c3b61 00002000:00100000:3.0:1787856730.301359:0:8407:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb/ffff9064c808a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787856730.301384:0:8407:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1787856730.301496:0:8407:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787856730.301537:0:8407:0:(import.c:65:import_set_state_nolock()) ffff9064c808d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856730.301627:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2398:x1874703426795392:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 423us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856730.301637:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1787856730.301656:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1787856730.301662:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874703426795520:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787856730.301702:0:8407:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb@192.168.202.6@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1787856730.301722:0:8407:0:(genops.c:1385:class_connect()) connect: client fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb, cookie 0xc25410d92a3c3b68 00002000:00100000:3.0:1787856730.301728:0:8407:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb/ffff9064c8089000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787856730.301742:0:8407:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1787856730.301781:0:8407:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787856730.301818:0:8407:0:(import.c:65:import_set_state_nolock()) ffff9066008be000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856730.301844:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2398:x1874703426795520:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 182us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856730.301852:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:0.0:1787856730.302602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426795648 00000100:00100000:0.0:1787856730.302612:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426795648 00000100:00100000:0.0:1787856730.302685:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:0.0:1787856730.302704:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:8722:x1874703426795648:12345-192.168.202.6@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787856730.302770:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:8722:x1874703426795648:12345-192.168.202.6@tcp:900:mount.lustre.0 Request processed in 68us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856730.302778:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1787856730.306665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856730.306874:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426795776 00000100:00100000:2.0:1787856730.306887:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426795776 00000100:00100000:2.0:1787856730.306969:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:2.0:1787856730.306981:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:8722:x1874703426795776:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787856730.307108:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787856730.307268:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:8722:x1874703426795776:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 289us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856730.307278:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00010000:00010000:0.0:1787856731.025586:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856732.050157:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856732.497422:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436306816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856732.497498:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856732.497553:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856732.497559:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436306944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856732.497587:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856732.497617:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436306816 00000100:00100000:3.0:1787856732.497623:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436306816 00000100:00100000:0.0:1787856732.497739:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436307072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856732.497765:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856732.497795:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436306944 00000100:00100000:0.0:1787856732.497798:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436306944 00000100:00100000:0.0:1787856732.497838:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436307072 00000100:00100000:0.0:1787856732.497842:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436307072 00000100:00100000:0.0:1787856732.497858:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787856732.497867:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436306944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856732.497894:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856732.497934:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436306944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.497941:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787856732.497957:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787856732.497962:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436307072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856732.497975:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856732.498000:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436307072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.498006:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1787856732.498034:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ec3c0 x1874703436307072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856732.498066:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436307072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856732.498156:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436307584:0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498191:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856732.498209:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436308096:0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498261:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856732.498279:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787856732.498284:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436307200:0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498310:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856732.498332:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436307712:0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498356:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856732.498370:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436308224:0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498387:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856732.498412:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436307584 00000100:00100000:0.0:1787856732.498416:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436307584 00000100:00100000:0.0:1787856732.498442:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436308096 00000100:00100000:0.0:1787856732.498445:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436308096 00000100:00100000:0.0:1787856732.498462:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436308224 00000100:00100000:0.0:1787856732.498464:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436308224 00000100:00100000:0.0:1787856732.498478:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787856732.498484:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436307584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498519:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436307584:12345-0@lo:400:kworker.0 Request processed in 35us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.498526:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787856732.498537:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787856732.498543:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436308096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498571:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436308096:12345-0@lo:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.498577:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787856732.498588:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787856732.498594:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436308224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498632:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436308224:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.498638:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787856732.498656:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436307200 00000100:00100000:0.0:1787856732.498660:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436307200 00000100:00100000:0.0:1787856732.498697:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787856732.498704:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436307200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.498732:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436307200:12345-0@lo:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.498739:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787856732.498763:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436307712 00000100:00100000:0.0:1787856732.498767:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436307712 00000100:00100000:0.0:1787856732.499310:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787856732.499319:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436307712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.499357:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436307712:12345-0@lo:400:kworker.0 Request processed in 40us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.499364:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787856732.499943:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436307200:0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.499959:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436307712:0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.499970:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436308224:0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.499980:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436307584:0@lo:400:kworker.0 00010000:00080000:0.0:1787856732.499993:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7ab9680 x1874703436308096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856732.500004:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436308096:0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.500685:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787856732.500697:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436306816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856732.500717:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856732.500765:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436306816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856732.500771:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787856732.500794:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856732.500799:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856732.500802:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856732.500804:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856732.500948:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436307456:0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.500983:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856732.501010:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436307968:0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.501031:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856732.501462:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787856732.501470:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436307328:0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.501498:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856732.501522:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436307840:0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.501546:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856732.502140:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436308352:0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.502178:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856732.502252:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436307840 00000100:00100000:0.0:1787856732.502299:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436307968 00000100:00100000:0.0:1787856732.502305:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436307968 00000100:00100000:0.0:1787856732.502352:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436307328 00000100:00100000:0.0:1787856732.502356:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436307328 00000100:00100000:0.0:1787856732.502371:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436308352 00000100:00100000:0.0:1787856732.502374:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436308352 00000100:00100000:0.0:1787856732.502390:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787856732.502398:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436307968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.502448:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436307968:12345-0@lo:400:kworker.0 Request processed in 51us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.502456:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787856732.502471:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787856732.502477:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436307328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.502504:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436307328:12345-0@lo:400:kworker.0 Request processed in 28us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.502509:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787856732.502519:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787856732.502524:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436308352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856732.502548:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436308352:12345-0@lo:400:kworker.0 Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856732.502553:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787856732.502646:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436307840 00000100:00100000:3.0:1787856732.502758:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787856732.502764:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436307840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.502792:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436307840:12345-0@lo:400:kworker.0 Request processed in 29us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856732.502797:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787856732.502813:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856732.502817:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856732.502996:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856732.503030:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436307328:0@lo:400:kworker.0 00010000:00080000:3.0:1787856732.503302:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ecb40 x1874703436307840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856732.503314:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436307840:0@lo:400:kworker.0 00010000:00080000:3.0:1787856732.503325:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7abb0c0 x1874703436308352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856732.503334:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436308352:0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.503343:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436307968:0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.503377:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436307456 00000100:00100000:3.0:1787856732.503381:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436307456 00000100:00100000:3.0:1787856732.505774:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787856732.505790:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436307456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856732.505870:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436307456:12345-0@lo:400:kworker.0 Request processed in 84us (4885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856732.505877:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1787856732.509542:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d69680 x1874703436306944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856732.509568:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436306944:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787856732.509583:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b0c0 x1874703436306816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856732.509595:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436306816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856732.512281:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436307456:0@lo:400:kworker.0 00000100:00100000:3.0:1787856733.009444:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436308480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856733.009513:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856733.009702:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436308480 00000100:00100000:0.0:1787856733.009712:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436308480 00000100:00100000:0.0:1787856733.009766:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787856733.009776:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436308480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856733.009800:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856733.018875:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436308480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9091us (9352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856733.018899:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1787856733.019950:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7063480 x1874703436308480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856733.021558:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436308480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856733.074656:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856733.521802:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436308608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856733.521876:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856733.521976:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436308608 00000100:00100000:1.0:1787856733.521983:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436308608 00000100:00100000:1.0:1787856733.522040:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787856733.522050:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436308608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856733.522082:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856733.522928:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436308608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856733.522934:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436308608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 770us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856733.522941:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787856734.039147:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856734.039169:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436308736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856734.039267:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856734.039335:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436308736 00000100:00100000:3.0:1787856734.039342:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436308736 00000100:00100000:3.0:1787856734.039386:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787856734.039394:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436308736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856734.039425:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856734.040728:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436308736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1333us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856734.040738:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787856734.043412:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436308736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856734.098272:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856735.121469:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856735.713163:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856735.713204:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856735.713255:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856735.713278:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856735.713298:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856735.713315:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856735.713338:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856735.713365:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426796160 00000100:00100000:3.0:1787856735.713383:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426796160 00000100:00100000:3.0:1787856735.713439:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426796416 00000100:00100000:3.0:1787856735.713442:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426796416 00000100:00100000:3.0:1787856735.713456:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426796032 00000100:00100000:3.0:1787856735.713458:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426796032 00000100:00100000:3.0:1787856735.713469:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426796288 00000100:00100000:3.0:1787856735.713472:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426796288 00000100:00100000:3.0:1787856735.713487:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:3.0:1787856735.713496:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426796160:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856735.713567:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426796160:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 71us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856735.713575:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:3.0:1787856735.713591:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:3.0:1787856735.713614:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2399:x1874703426796416:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856735.713657:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2399:x1874703426796416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 44us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856735.713663:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:3.0:1787856735.713675:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:3.0:1787856735.713681:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426796032:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856735.713702:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426796032:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 21us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856735.713708:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:3.0:1787856735.713718:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 149 00000100:00100000:3.0:1787856735.713724:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2399:x1874703426796288:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856735.713747:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2399:x1874703426796288:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856735.713763:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 149 00000100:00100000:3.0:1787856735.713785:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426796672 00000100:00100000:3.0:1787856735.713788:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426796672 00000100:00100000:3.0:1787856735.713813:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426796544 00000100:00100000:3.0:1787856735.713816:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426796544 00000100:00100000:3.0:1787856735.713835:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:3.0:1787856735.713841:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2399:x1874703426796672:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856735.713884:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2399:x1874703426796672:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 43us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856735.713891:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:3.0:1787856735.713903:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1787856735.713909:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2399:x1874703426796544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856735.713931:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2399:x1874703426796544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856735.713937:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00080000:3.0:1787856735.713957:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856735.713960:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856735.713963:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856735.713965:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856735.714252:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426795904 00000100:00100000:2.0:1787856735.714257:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426795904 00000100:00100000:2.0:1787856735.714289:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 306 00000100:00100000:2.0:1787856735.714304:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426795904:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856735.714340:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426795904:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 36us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856735.714347:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 306 00000001:00100000:1.0:1787856736.092849:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000001:00100000:1.0:1787856736.093731:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000001:00100000:3.0:1787856736.094181:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000001:00100000:0.0:1787856736.100711:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00010000:00010000:2.0:1787856736.152938:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787856736.327113:0:12165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787856737.170091:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856737.620844:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436309120:0@lo:400:kworker.0 00000100:00100000:0.0:1787856737.620921:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856737.621036:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856737.621044:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436309248:0@lo:400:kworker.0 00000100:00100000:0.0:1787856737.621077:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856737.621120:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436308864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856737.621159:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856737.621185:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856737.621191:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7061e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436308992:0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.621257:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856737.621289:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436309376:0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.621314:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856737.621336:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856737.621343:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436309504:0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.621366:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856737.621401:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436308864 00000100:00100000:1.0:1787856737.621408:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436308864 00000100:00100000:1.0:1787856737.621467:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787856737.621480:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436308864:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856737.621499:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436309760:0@lo:400:kworker.0 00002000:00000024:1.0:1787856737.621512:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856737.621531:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856737.621559:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436310272:0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.621567:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436308864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856737.621576:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787856737.621592:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856737.621604:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436308992 00000100:00100000:1.0:1787856737.621609:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436308992 00000100:00100000:2.0:1787856737.621617:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787856737.621639:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436309632:0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.621653:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787856737.621662:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436308992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.621783:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856737.621848:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436310272 00000100:00100000:0.0:1787856737.621853:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436310272 00000100:00100000:0.0:1787856737.621878:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436309632 00000100:00100000:0.0:1787856737.621881:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436309632 00000100:00100000:0.0:1787856737.621901:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787856737.621908:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436310272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.623321:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436308992:12345-0@lo:400:kworker.0 Request processed in 1655us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856737.623333:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787856737.623435:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436310144:0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.623732:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856737.623791:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436309888:0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.623818:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856737.623835:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436310400:0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.623858:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856737.623883:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7061e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436308992:0@lo:400:kworker.0 00010000:00080000:2.0:1787856737.623901:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7ab8780 x1874703436308864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856737.623921:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436308864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856737.623960:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856737.623962:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436309120 00000100:00100000:2.0:1787856737.623968:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436310016:0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.623978:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436309120 00000100:00100000:2.0:1787856737.623999:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856737.624026:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436309376 00000100:00100000:1.0:1787856737.624029:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436309760 00000100:00100000:2.0:1787856737.624031:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436309376 00000100:00100000:1.0:1787856737.624035:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436309760 00000100:00100000:2.0:1787856737.624059:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436310144 00000100:00100000:2.0:1787856737.624064:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436310144 00000100:00100000:1.0:1787856737.624064:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436309888 00000100:00100000:1.0:1787856737.624070:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436309888 00000100:00100000:2.0:1787856737.624090:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436310016 00000100:00100000:2.0:1787856737.624095:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436310016 00000100:00100000:1.0:1787856737.624101:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787856737.624112:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436309120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.624119:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787856737.624128:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436309376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.624170:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436309120:12345-0@lo:400:kworker.0 Request processed in 60us (3248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856737.624178:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787856737.624183:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436309376:12345-0@lo:400:kworker.0 Request processed in 55us (2868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856737.624191:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787856737.624196:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787856737.624204:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436309760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.624211:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787856737.624241:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436310144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.624257:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436309760:12345-0@lo:400:kworker.0 Request processed in 54us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856737.624262:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787856737.624274:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787856737.624280:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436309888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.624284:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436310144:12345-0@lo:400:kworker.0 Request processed in 63us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856737.624293:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787856737.624311:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787856737.624318:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436309888:12345-0@lo:400:kworker.0 Request processed in 38us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856737.624322:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436310016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.624330:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787856737.624570:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436310016:12345-0@lo:400:kworker.0 Request processed in 251us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856737.624577:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787856737.624601:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436310400 00000100:00100000:2.0:1787856737.624605:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436310400 00000100:00100000:2.0:1787856737.624636:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787856737.624651:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436309632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.624694:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436309632:12345-0@lo:400:kworker.0 Request processed in 46us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856737.624700:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787856737.624714:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787856737.624720:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436310400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.624748:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436310400:12345-0@lo:400:kworker.0 Request processed in 29us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856737.624754:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787856737.624857:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436310016:0@lo:400:kworker.0 00010000:00080000:2.0:1787856737.624870:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe80e580 x1874703436309888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856737.624880:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436309888:0@lo:400:kworker.0 00010000:00080000:2.0:1787856737.624889:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ef840 x1874703436310400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856737.624897:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436310400:0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.624907:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436309376:0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.624924:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436309120:0@lo:400:kworker.0 00010000:00080000:1.0:1787856737.624962:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7063480 x1874703436309632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856737.624971:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436309632:0@lo:400:kworker.0 00010000:00080000:1.0:1787856737.624983:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe80de00 x1874703436310144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856737.625040:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436310272:12345-0@lo:400:kworker.0 Request processed in 3131us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856737.625048:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787856737.625087:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436310144:0@lo:400:kworker.0 00000100:00100000:1.0:1787856737.625103:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436309760:0@lo:400:kworker.0 00010000:00080000:1.0:1787856737.625114:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe80cb40 x1874703436310272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856737.625123:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436310272:0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.625493:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856737.625506:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9c7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436310528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856737.625513:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436309248 00000100:00100000:3.0:1787856737.625520:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436309248 00000100:00100000:3.0:1787856737.625548:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436309504 00000100:00100000:2.0:1787856737.625548:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856737.625553:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436309504 00000100:00100000:3.0:1787856737.625571:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787856737.625580:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436309248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856737.625588:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436310528 00000100:00100000:2.0:1787856737.625593:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436310528 00000100:00100000:2.0:1787856737.625633:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787856737.625643:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066009f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436310528:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856737.625654:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436309248:12345-0@lo:400:kworker.0 Request processed in 74us (4576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856737.625662:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787856737.625678:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787856737.625684:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436309504:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787856737.625736:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856737.625769:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066009f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436310528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856737.625772:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436309504:12345-0@lo:400:kworker.0 Request processed in 35us (4352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856737.625779:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787856737.625785:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1787856737.625817:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856737.625821:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856737.625825:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856737.625828:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787856737.625929:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d9c7b840 x1874703436310528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856737.625946:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9c7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436310528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856737.625963:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436309504:0@lo:400:kworker.0 00000100:00100000:3.0:1787856737.625986:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787856737.626213:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436310656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856737.626269:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856737.626331:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436310656 00000100:00100000:0.0:1787856737.626336:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436310656 00000100:00100000:0.0:1787856737.626405:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787856737.626414:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436310656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856737.626434:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856737.626478:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436310656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856737.626486:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1787856737.626493:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d9c78000 x1874703436310656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856737.626576:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436310656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856737.636465:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436309248:0@lo:400:kworker.0 00000100:00100000:3.0:1787856738.131405:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436310784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856738.131476:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856738.131787:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436310784 00000100:00100000:2.0:1787856738.131795:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436310784 00000100:00100000:2.0:1787856738.131858:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787856738.131867:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436310784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856738.131889:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856738.132315:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436310784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 449us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856738.132322:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1787856738.132402:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ef840 x1874703436310784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856738.132421:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436310784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856738.193432:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856738.642496:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856738.642530:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9c7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436310912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856738.642625:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856738.642915:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436310912 00000100:00100000:3.0:1787856738.642924:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436310912 00000100:00100000:3.0:1787856738.642981:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787856738.642990:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436310912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856738.643024:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856738.643074:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436310912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856738.643081:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787856738.643288:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9c7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436310912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856739.156716:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856739.156742:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436311040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856739.156819:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856739.157052:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436311040 00000100:00100000:1.0:1787856739.157061:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436311040 00000100:00100000:1.0:1787856739.157117:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787856739.157128:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436311040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856739.157172:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856739.157243:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436311040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856739.157251:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787856739.157299:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436311040:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856739.218373:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856740.254411:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856740.828487:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856740.828529:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856740.828559:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856740.828602:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856740.828625:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856740.828645:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856740.828667:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856740.828693:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426797056 00000100:00100000:3.0:1787856740.828702:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426797056 00000100:00100000:3.0:1787856740.828755:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426797312 00000100:00100000:3.0:1787856740.828758:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426797312 00000100:00100000:3.0:1787856740.828771:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426796928 00000100:00100000:3.0:1787856740.828773:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426796928 00000100:00100000:3.0:1787856740.828785:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426797184 00000100:00100000:3.0:1787856740.828786:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426797184 00000100:00100000:3.0:1787856740.828801:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 156 00000100:00100000:3.0:1787856740.828810:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426797056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856740.828899:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426797056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 89us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856740.828907:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 156 00000100:00100000:3.0:1787856740.828924:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 157 00000100:00100000:3.0:1787856740.828931:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426797312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856740.828953:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426797312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856740.828960:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 157 00000100:00100000:3.0:1787856740.828970:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:3.0:1787856740.828975:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426796928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856740.828995:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426796928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 20us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856740.829000:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:3.0:1787856740.829009:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:3.0:1787856740.829015:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426797184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856740.829047:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426797184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856740.829053:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00080000:3.0:1787856740.829075:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856740.829078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856740.829888:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426796800 00000100:00100000:2.0:1787856740.829897:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426796800 00000100:00100000:2.0:1787856740.829947:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 308 00000100:00100000:2.0:1787856740.829956:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426796800:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856740.830013:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426796800:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 57us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856740.830021:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 308 00000100:00100000:2.0:1787856740.830059:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426797568 00000100:00100000:2.0:1787856740.830063:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426797568 00000100:00100000:2.0:1787856740.830099:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426797440 00000100:00100000:2.0:1787856740.830102:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426797440 00000100:00100000:2.0:1787856740.830120:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:2.0:1787856740.830126:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426797568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856740.830150:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426797568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856740.830166:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00080000:3.0:1787856740.830173:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856740.830178:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856740.830179:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:2.0:1787856740.830187:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426797440:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856740.830206:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426797440:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 21us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856740.830212:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00010000:00010000:3.0:1787856741.267166:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856742.291174:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856742.737881:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856742.737903:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436311168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856742.737971:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.738031:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436311168 00000100:00100000:1.0:1787856742.738046:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436311168 00000100:00100000:1.0:1787856742.738101:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787856742.738111:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436311168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787856742.738139:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856742.738185:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436311168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.738191:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1787856742.738212:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856742.738889:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856742.738901:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7aba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436311296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856742.738916:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436311424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856742.738938:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856742.738966:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436311296 00000100:00100000:0.0:1787856742.738971:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436311296 00000100:00100000:1.0:1787856742.739404:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436311680:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.739433:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.739454:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8216d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436312192:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.739476:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.739494:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8215e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436312704:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.739514:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.739532:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787856742.739537:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436311808:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.739559:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.739586:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436312320:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.739606:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.739623:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436312832:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.739643:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.739668:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436311680 00000100:00100000:1.0:1787856742.739672:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436311680 00000100:00100000:1.0:1787856742.739704:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436312704 00000100:00100000:1.0:1787856742.739706:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436312704 00000100:00100000:1.0:1787856742.739909:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436312320 00000100:00100000:1.0:1787856742.739913:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436312320 00000100:00100000:1.0:1787856742.739938:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436312832 00000100:00100000:1.0:1787856742.739942:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436312832 00000100:00100000:1.0:1787856742.739956:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787856742.739963:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8215680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436311680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.740018:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8215680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436311680:12345-0@lo:400:kworker.0 Request processed in 55us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.740024:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787856742.740037:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787856742.740043:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8217c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436312704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.740077:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8217c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436312704:12345-0@lo:400:kworker.0 Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.740083:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787856742.740096:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787856742.740103:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8214f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436312320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.740133:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8214f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436312320:12345-0@lo:400:kworker.0 Request processed in 32us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.740140:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787856742.740154:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787856742.740162:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8216580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436312832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.740192:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8216580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436312832:12345-0@lo:400:kworker.0 Request processed in 32us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.740200:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787856742.740256:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436312192 00000100:00100000:1.0:1787856742.740260:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436312192 00000100:00100000:1.0:1787856742.740291:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856742.740300:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8216940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436312192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.740414:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8216940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436312192:12345-0@lo:400:kworker.0 Request processed in 116us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.740420:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856742.740440:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436311808 00000100:00100000:1.0:1787856742.740444:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436311808 00000100:00100000:1.0:1787856742.740464:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787856742.740470:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436311808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.740499:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436311808:12345-0@lo:400:kworker.0 Request processed in 30us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.740505:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1787856742.740532:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856742.740536:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856742.740538:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856742.740631:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436311808:0@lo:400:kworker.0 00000100:00100000:2.0:1787856742.740643:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436312320:0@lo:400:kworker.0 00010000:00080000:2.0:1787856742.740653:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c82161c0 x1874703436312832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856742.740662:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436312832:0@lo:400:kworker.0 00000100:00100000:2.0:1787856742.740671:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436311680:0@lo:400:kworker.0 00010000:00080000:2.0:1787856742.740679:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8216d00 x1874703436312192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856742.740687:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8216d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436312192:0@lo:400:kworker.0 00000100:00100000:2.0:1787856742.740696:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8215e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436312704:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.741278:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.741384:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436311936:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.741420:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856742.741437:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436312448:0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.741455:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856742.741455:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436311424 00000100:00100000:0.0:1787856742.741459:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436311424 00000100:00100000:1.0:1787856742.741472:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787856742.741477:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787856742.741478:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436311552:0@lo:400:kworker.0 00000100:00100000:0.0:1787856742.741484:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436311296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856742.741500:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787856742.741501:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856742.741521:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436312064:0@lo:400:kworker.0 00000100:00100000:0.0:1787856742.741533:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436311296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.741539:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856742.741540:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787856742.741554:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436312576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856742.741565:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787856742.741580:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8214780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436311424:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856742.741583:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787856742.741599:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856742.741606:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436311936 00000100:00100000:1.0:1787856742.741614:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436311936 00000100:00100000:0.0:1787856742.741629:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8214780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436311424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.741636:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436312448 00000100:00100000:1.0:1787856742.741638:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436312448 00000100:00100000:0.0:1787856742.741650:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787856742.741658:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787856742.741663:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436311936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856742.741692:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436311936:12345-0@lo:400:kworker.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856742.741698:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787856742.741698:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436312064 00000100:00100000:0.0:1787856742.741701:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436312064 00000100:00100000:1.0:1787856742.741710:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787856742.741715:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8217840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436312448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856742.741719:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787856742.741724:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8215e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436312064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856742.741753:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8215e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436312064:12345-0@lo:400:kworker.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856742.741759:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1787856742.741792:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b840 x1874703436311168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856742.741809:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436311168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856742.741825:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8217840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436312448:12345-0@lo:400:kworker.0 Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00080000:0.0:1787856742.741828:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856742.741830:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1787856742.741831:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856742.741833:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856742.741857:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436312064:0@lo:400:kworker.0 00000100:00100000:0.0:1787856742.741866:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436311936:0@lo:400:kworker.0 00010000:00080000:0.0:1787856742.741875:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8214b40 x1874703436312448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856742.741883:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436312448:0@lo:400:kworker.0 00010000:00080000:0.0:1787856742.741892:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7abad00 x1874703436311424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856742.741902:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436311424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856742.741907:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436311552 00000100:00100000:2.0:1787856742.741911:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436311552 00000100:00100000:2.0:1787856742.742410:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787856742.742420:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436311552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856742.742465:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436311552:12345-0@lo:400:kworker.0 Request processed in 47us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856742.742477:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787856742.742507:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436312576 00000100:00100000:2.0:1787856742.742511:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436312576 00000100:00100000:2.0:1787856742.742535:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787856742.742541:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436312576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856742.742570:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436312576:12345-0@lo:400:kworker.0 Request processed in 30us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856742.742586:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787856742.742622:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7aba940 x1874703436311296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856742.742637:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7aba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436311296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856742.746956:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436311552:0@lo:400:kworker.0 00010000:00080000:0.0:1787856742.746989:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c82170c0 x1874703436312576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856742.747001:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436312576:0@lo:400:kworker.0 00000100:00100000:1.0:1787856743.250471:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856743.250494:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436312960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856743.250591:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856743.250935:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436312960 00000100:00100000:2.0:1787856743.250943:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436312960 00000100:00100000:2.0:1787856743.250994:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787856743.251003:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436312960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856743.251025:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856743.251079:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436312960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856743.251087:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1787856743.251206:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ef0c0 x1874703436312960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856743.251276:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436312960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856743.314676:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856743.762878:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436313088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856743.762954:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856743.763056:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436313088 00000100:00100000:0.0:1787856743.763064:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436313088 00000100:00100000:0.0:1787856743.763114:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787856743.763124:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436313088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856743.763161:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856743.764308:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436313088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1181us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856743.764320:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787856743.764463:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436313088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856744.273793:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787856744.273817:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436313216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856744.273888:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856744.274393:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436313216 00000100:00100000:1.0:1787856744.274401:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436313216 00000100:00100000:1.0:1787856744.274453:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787856744.274461:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436313216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856744.274505:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856744.274552:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436313216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856744.274568:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787856744.274795:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436313216:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1787856744.333814:0:12481:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856744.334060:0:12481:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787856744.341720:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856745.371410:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856745.948809:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856745.948852:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856745.948958:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856745.949001:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856745.949024:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856745.954349:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856745.954477:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426797824 00000100:00100000:2.0:1787856745.954487:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426797824 00000100:00100000:2.0:1787856745.954589:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426798080 00000100:00100000:2.0:1787856745.954593:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426798080 00000100:00100000:2.0:1787856745.954619:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426797952 00000100:00100000:2.0:1787856745.954636:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426797952 00000100:00100000:2.0:1787856745.954657:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:2.0:1787856745.954668:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426797824:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856745.954747:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426797824:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (5948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856745.955175:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:2.0:1787856745.955197:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:2.0:1787856745.955206:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426798080:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856745.955257:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426798080:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 54us (6404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856745.955264:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:2.0:1787856745.955276:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:2.0:1787856745.955283:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426797952:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856745.955308:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426797952:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (6284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856745.955315:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00080000:2.0:1787856745.955339:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856745.955343:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856745.955401:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426797696 00000100:00100000:2.0:1787856745.955406:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426797696 00000100:00100000:2.0:1787856745.955435:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 310 00000100:00100000:2.0:1787856745.955441:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426797696:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856745.955467:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426797696:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (6466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856745.955472:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 310 00000100:00100000:2.0:1787856745.955509:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426798336 00000100:00100000:2.0:1787856745.955513:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426798336 00000100:00100000:2.0:1787856745.955621:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:2.0:1787856745.955628:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426798336:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856745.955657:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426798336:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (6701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856745.955664:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00080000:2.0:1787856745.955681:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856745.962070:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856745.962122:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426798464 00000100:00100000:3.0:1787856745.962134:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426798464 00000100:00100000:3.0:1787856745.962243:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1787856745.962257:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426798464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856745.962336:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426798464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856745.962345:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00080000:3.0:1787856745.962384:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856745.962478:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426798208 00000100:00100000:0.0:1787856745.962484:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426798208 00000100:00080000:3.0:1787856745.964207:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856745.967334:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:1.0:1787856745.967356:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426798208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856745.967452:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426798208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 106us (13114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856745.967461:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 169 00010000:00010000:0.0:1787856746.387856:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787856746.632892:0:12578:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787856746.633118:0:12578:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787856747.410604:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856747.858575:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436313344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856747.858644:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856747.858719:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436313344 00000100:00100000:0.0:1787856747.858727:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436313344 00000100:00100000:0.0:1787856747.858796:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787856747.858806:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436313344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856747.858836:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856747.858882:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436313344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856747.858906:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787856747.858928:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856747.858956:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7ab8b40 x1874703436313344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856747.858974:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436313344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856747.869450:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436313472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856747.869544:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856747.869610:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856747.869617:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436313600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856747.869641:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.869716:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436313472 00000100:00100000:2.0:1787856747.869724:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436313472 00000100:00100000:2.0:1787856747.869811:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436313600 00000100:00100000:2.0:1787856747.869815:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436313600 00000100:00100000:2.0:1787856747.869836:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787856747.869845:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436313472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856747.869875:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856747.869918:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436313472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.869924:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787856747.869941:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787856747.869947:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436313600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856747.869957:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856747.869982:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436313600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.869987:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787856747.871323:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856747.871330:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787856747.871375:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066007c0f00 x1874703436313600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856747.871398:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436313600:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787856747.871410:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ed2c0 x1874703436313472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856747.871422:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436313472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856747.877687:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436313856:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.877786:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.877832:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436314368:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.877853:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.877865:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436314880:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.877877:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.877895:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787856747.877899:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436313728:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.877915:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.877926:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436314240:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.877940:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.877950:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436314752:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.877961:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.877976:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436313984:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.877989:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.877999:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436314496:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878018:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.878037:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787856747.878042:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436314112:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878062:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.878076:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436314624:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878095:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856747.878135:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436313856 00000100:00100000:2.0:1787856747.878143:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436313856 00000100:00100000:2.0:1787856747.878183:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436314880 00000100:00100000:2.0:1787856747.878186:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436314880 00000100:00100000:2.0:1787856747.878209:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436314752 00000100:00100000:2.0:1787856747.878211:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436314752 00000100:00100000:2.0:1787856747.878267:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436314496 00000100:00100000:2.0:1787856747.878270:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436314496 00000100:00100000:2.0:1787856747.878282:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436314112 00000100:00100000:2.0:1787856747.878285:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436314112 00000100:00100000:2.0:1787856747.878294:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436314624 00000100:00100000:2.0:1787856747.878296:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436314624 00000100:00100000:2.0:1787856747.878311:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787856747.878318:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436313856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878371:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436313856:12345-0@lo:400:kworker.0 Request processed in 53us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.878378:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787856747.878394:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787856747.878400:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436314880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878426:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436314880:12345-0@lo:400:kworker.0 Request processed in 27us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.878432:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787856747.878443:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787856747.878449:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436314752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878475:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436314752:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.878481:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787856747.878494:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787856747.878499:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436314496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878539:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436314496:12345-0@lo:400:kworker.0 Request processed in 40us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.878545:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787856747.878555:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787856747.878567:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436314112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878594:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436314112:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.878600:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787856747.878611:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787856747.878616:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436314624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878641:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436314624:12345-0@lo:400:kworker.0 Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.878647:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787856747.878665:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436314368 00000100:00100000:2.0:1787856747.878668:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436314368 00000100:00100000:2.0:1787856747.878695:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787856747.878701:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436314368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878728:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436314368:12345-0@lo:400:kworker.0 Request processed in 28us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.878734:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787856747.878754:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436313728 00000100:00100000:2.0:1787856747.878758:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436313728 00000100:00100000:2.0:1787856747.878780:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787856747.878785:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436313728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878812:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436313728:12345-0@lo:400:kworker.0 Request processed in 27us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856747.878818:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:2.0:1787856747.878842:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787856747.878846:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856747.878848:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856747.878893:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436314112:0@lo:400:kworker.0 00010000:00080000:2.0:1787856747.878914:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b480 x1874703436314624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856747.878925:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436314624:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878935:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436314496:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878963:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436313728:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878972:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436314752:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.878982:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436313856:0@lo:400:kworker.0 00010000:00080000:2.0:1787856747.878991:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d69a40 x1874703436314368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856747.878998:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436314368:0@lo:400:kworker.0 00010000:00080000:2.0:1787856747.879006:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b840 x1874703436314880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856747.879013:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436314880:0@lo:400:kworker.0 00000100:00100000:3.0:1787856747.880125:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436314240 00000100:00100000:3.0:1787856747.880135:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436314240 00000100:00100000:3.0:1787856747.880170:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436313984 00000100:00100000:3.0:1787856747.880174:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436313984 00000100:00100000:3.0:1787856747.880190:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787856747.880197:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436314240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856747.880303:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436314240:12345-0@lo:400:kworker.0 Request processed in 106us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856747.880311:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787856747.880326:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787856747.880331:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436313984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856747.880363:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436313984:12345-0@lo:400:kworker.0 Request processed in 32us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856747.880369:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787856747.880400:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436313984:0@lo:400:kworker.0 00000100:00100000:2.0:1787856747.883508:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436314240:0@lo:400:kworker.0 00000100:00100000:2.0:1787856748.369385:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436315008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856748.369443:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856748.369505:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436315008 00000100:00100000:2.0:1787856748.369512:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436315008 00000100:00100000:2.0:1787856748.369571:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787856748.369581:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436315008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856748.369604:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856748.369650:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436315008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856748.369656:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1787856748.369708:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826da40 x1874703436315008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856748.369725:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436315008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787856748.433801:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787856748.666370:0:12676:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787856748.667475:0:12676:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787856748.884465:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436315136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856748.884552:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856748.884629:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436315136 00000100:00100000:0.0:1787856748.884636:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436315136 00000100:00100000:0.0:1787856748.884679:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787856748.884697:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436315136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856748.884737:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856748.884782:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436315136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856748.884789:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787856748.884837:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436315136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856749.399488:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436315264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856749.399707:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856749.399818:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436315264 00000100:00100000:3.0:1787856749.399825:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436315264 00000100:00100000:3.0:1787856749.399887:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787856749.399896:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436315264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856749.399928:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856749.399974:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436315264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856749.399981:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787856749.400068:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436315264:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856749.457928:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856750.481813:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787856750.765018:0:12773:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856750.765960:0:12773:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787856751.083395:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856751.083448:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856751.083582:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426799232 00000100:00100000:1.0:1787856751.083593:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426799232 00000100:00100000:1.0:1787856751.083655:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426799360 00000100:00100000:1.0:1787856751.083658:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426799360 00000100:00100000:1.0:1787856751.083682:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1787856751.083693:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2398:x1874703426799232:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:1.0:1787856751.083734:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3b61 00000100:00080000:1.0:1787856751.083744:0:8410:0:(import.c:65:import_set_state_nolock()) ffff9064c808d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787856751.083801:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787856751.083958:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+2:2398:x1874703426799232:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 267us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856751.083967:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1787856751.083983:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:1.0:1787856751.083991:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2398:x1874703426799360:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:1.0:1787856751.084019:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3b68 00000100:00080000:1.0:1787856751.084027:0:8410:0:(import.c:65:import_set_state_nolock()) ffff9066008be000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787856751.084050:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787856751.084118:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+2:2398:x1874703426799360:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 128us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856751.084124:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00010000:00010000:1.0:1787856751.084151:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856751.084637:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856751.084850:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856751.084910:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856751.084934:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856751.084952:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856751.084993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856751.085014:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426798848 00000100:00100000:0.0:1787856751.085021:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426798848 00000100:00100000:0.0:1787856751.085053:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426799104 00000100:00100000:0.0:1787856751.085056:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426799104 00000100:00100000:0.0:1787856751.085067:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426798720 00000100:00100000:0.0:1787856751.085069:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426798720 00000100:00100000:0.0:1787856751.085079:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426798976 00000100:00100000:0.0:1787856751.085081:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426798976 00000100:00100000:0.0:1787856751.085094:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 176 00000100:00100000:0.0:1787856751.085101:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426798848:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856751.085153:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426798848:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856751.085160:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 176 00000100:00100000:0.0:1787856751.085175:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 177 00000100:00100000:0.0:1787856751.085181:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426799104:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856751.085202:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426799104:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856751.085208:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 177 00000100:00100000:0.0:1787856751.085235:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 178 00000100:00100000:0.0:1787856751.085242:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426798720:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856751.085262:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426798720:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856751.085268:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 178 00000100:00100000:0.0:1787856751.085278:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:0.0:1787856751.085282:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426798976:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856751.085299:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426798976:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 17us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856751.085306:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:1.0:1787856751.087523:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426798592 00000100:00100000:1.0:1787856751.087537:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426798592 00000100:00100000:1.0:1787856751.087599:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 312 00000100:00100000:1.0:1787856751.087609:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426798592:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856751.087668:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426798592:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 60us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856751.087675:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 312 00000100:00080000:1.0:1787856751.087942:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856751.087947:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856751.087950:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787856751.087953:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787856751.505428:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856752.529495:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787856752.831865:0:12871:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787856752.832164:0:12871:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787856752.977954:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436315392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856752.978055:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.978150:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436315520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856752.978198:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.978255:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436315392 00000100:00100000:0.0:1787856752.978264:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436315392 00000100:00100000:0.0:1787856752.978328:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436315520 00000100:00100000:0.0:1787856752.978331:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436315520 00000100:00100000:0.0:1787856752.978348:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787856752.978356:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436315392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856752.978396:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856752.978444:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436315392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.978452:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787856752.978473:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787856752.978493:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436315520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856752.978505:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856752.978534:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436315520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.978540:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1787856752.978588:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ee940 x1874703436315520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856752.978609:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436315520:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787856752.978642:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ee580 x1874703436315392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856752.978654:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436315392:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787856752.981354:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856752.983384:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856752.983414:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436315648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856752.983521:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856752.983587:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436315648 00000100:00100000:2.0:1787856752.983597:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436315648 00000100:00100000:2.0:1787856752.983666:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787856752.983677:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436315648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856752.983712:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856752.983774:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436315648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856752.983782:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1787856752.983831:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d692c0 x1874703436315648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856752.983850:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436315648:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787856752.984143:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856752.984173:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436316032:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984210:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.984263:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436316544:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984291:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.984321:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787856752.984326:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436316160:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984349:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.984366:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436316672:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984392:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.984424:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436316032 00000100:00100000:0.0:1787856752.984429:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436316032 00000100:00100000:0.0:1787856752.984464:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787856752.984471:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436316032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984527:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436316032:12345-0@lo:400:kworker.0 Request processed in 55us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.984534:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787856752.984555:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436316544 00000100:00100000:0.0:1787856752.984558:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436316544 00000100:00100000:0.0:1787856752.984590:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436316160 00000100:00100000:0.0:1787856752.984593:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436316160 00000100:00100000:0.0:1787856752.984611:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436316672 00000100:00100000:0.0:1787856752.984613:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436316672 00000100:00100000:0.0:1787856752.984630:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787856752.984636:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436316544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984668:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436316544:12345-0@lo:400:kworker.0 Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.984674:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787856752.984695:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787856752.984701:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436316160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984732:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436316160:12345-0@lo:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.984738:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787856752.984749:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787856752.984755:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436316672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984782:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436316672:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.984788:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1787856752.984815:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856752.984818:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856752.984828:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436315904:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984856:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.984875:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436316416:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984899:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.984918:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436316928:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984940:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.984957:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787856752.984963:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436315776:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.984992:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.985015:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436316288:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985037:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.985052:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436316800:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985072:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856752.985111:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436315776 00000100:00100000:0.0:1787856752.985114:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436315776 00000100:00100000:0.0:1787856752.985147:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787856752.985154:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436315776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985191:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436315776:12345-0@lo:400:kworker.0 Request processed in 38us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.985197:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787856752.985255:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436315904 00000100:00100000:0.0:1787856752.985259:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436315904 00000100:00100000:0.0:1787856752.985273:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436316928 00000100:00100000:0.0:1787856752.985275:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436316928 00000100:00100000:0.0:1787856752.985290:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436316800 00000100:00100000:0.0:1787856752.985293:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436316800 00000100:00100000:0.0:1787856752.985304:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787856752.985309:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436315904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985338:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436315904:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.985343:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787856752.985353:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787856752.985358:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436316928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985378:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436316928:12345-0@lo:400:kworker.0 Request processed in 21us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.985383:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787856752.985392:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787856752.985397:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9dea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436316800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985419:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9dea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436316800:12345-0@lo:400:kworker.0 Request processed in 22us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.985435:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1787856752.985450:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856752.985453:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856752.985460:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436316288 00000100:00100000:0.0:1787856752.985463:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436316288 00000100:00100000:0.0:1787856752.985493:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787856752.985500:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436316288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985530:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436316288:12345-0@lo:400:kworker.0 Request processed in 31us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856752.985536:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787856752.985571:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436316160:0@lo:400:kworker.0 00010000:00080000:0.0:1787856752.985584:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c80cd680 x1874703436316672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856752.985594:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436316672:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985606:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436316032:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985616:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436316544:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985645:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436315776:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985654:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436316288:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985661:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436316800:0@lo:400:kworker.0 00000100:00100000:0.0:1787856752.985669:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436315904:0@lo:400:kworker.0 00010000:00080000:0.0:1787856752.985678:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c80cc000 x1874703436316928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856752.985698:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436316928:0@lo:400:kworker.0 00000100:00100000:1.0:1787856752.987334:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436316416 00000100:00100000:1.0:1787856752.987347:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436316416 00000100:00100000:1.0:1787856752.987429:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787856752.987439:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436316416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856752.987560:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436316416:12345-0@lo:400:kworker.0 Request processed in 121us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856752.987569:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787856752.987646:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ef0c0 x1874703436316416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856752.987663:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436316416:0@lo:400:kworker.0 00000100:00080000:3.0:1787856752.987744:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856753.496765:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9debc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436317056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856753.496870:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856753.497946:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436317056 00000100:00100000:1.0:1787856753.497959:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436317056 00000100:00100000:1.0:1787856753.498035:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787856753.498047:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436317056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856753.498081:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856753.498159:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436317056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856753.498168:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1787856753.498243:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d9debc00 x1874703436317056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856753.498268:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9debc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436317056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787856753.554808:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856754.010633:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436317184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856754.010742:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856754.010829:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436317184 00000100:00100000:1.0:1787856754.010840:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436317184 00000100:00100000:1.0:1787856754.010918:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787856754.010930:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436317184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856754.011164:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787856754.020739:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436317184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9794us (9980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856754.020759:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787856754.024203:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436317184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856754.515051:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856754.515077:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436317312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856754.515146:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856754.515231:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436317312 00000100:00100000:0.0:1787856754.515239:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436317312 00000100:00100000:0.0:1787856754.515576:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787856754.515585:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9debc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436317312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787856754.515618:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787856754.515670:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9debc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436317312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856754.515677:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787856754.515721:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436317312:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856754.577626:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856755.604078:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856756.188149:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856756.188189:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856756.188331:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426799616 00000100:00100000:3.0:1787856756.188345:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426799616 00000100:00100000:3.0:1787856756.188417:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426799872 00000100:00100000:3.0:1787856756.188420:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426799872 00000100:00100000:3.0:1787856756.188529:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 186 00000100:00100000:3.0:1787856756.188541:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426799616:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856756.188755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856756.188801:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:0.0:1787856756.188815:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8214b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426799872:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856756.188997:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426799616:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 457us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856756.189016:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 186 00000100:00080000:3.0:1787856756.189048:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856756.193641:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856756.194736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856756.194858:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8214b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426799872:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 6043us (6663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856756.194878:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:3.0:1787856756.195648:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426799488 00000100:00100000:3.0:1787856756.195662:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426799488 00000100:00100000:3.0:1787856756.195735:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 314 00000100:00100000:3.0:1787856756.195746:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426799488:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856756.195817:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426799488:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 73us (7062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856756.195825:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 314 00000100:00100000:0.0:1787856756.198008:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426799744 00000100:00100000:0.0:1787856756.198026:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426799744 00000100:00080000:1.0:1787856756.198131:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856756.207261:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426800000 00000100:00100000:0.0:1787856756.207309:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426800000 00000100:00100000:0.0:1787856756.207411:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:0.0:1787856756.207424:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426799744:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856756.207562:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426799744:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 140us (13937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856756.207570:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:0.0:1787856756.207596:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:0.0:1787856756.207602:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8282d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426800000:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856756.207629:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8282d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426800000:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (13197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856756.207636:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00080000:2.0:1787856756.207739:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787856756.626557:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787856756.646114:0:13015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787856757.077712:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000020:00000080:1.0:1787856757.077725:0:8402:0:(genops.c:885:class_export_put()) final put ffff9064c808a800/fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000020:00000080:0.0:1787856757.077807:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c808a800/fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb for lustre-OST0000 00000020:00000080:0.0:1787856757.077873:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c808d000 for lustre-OST0000 00000001:00100000:2.0:1787856757.092412:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000020:00000080:2.0:1787856757.092427:0:9490:0:(genops.c:885:class_export_put()) final put ffff9064c8089000/fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000020:00000080:3.0:1787856757.092721:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c8089000/fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb for lustre-OST0001 00000020:00000080:3.0:1787856757.092801:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9066008be000 for lustre-OST0001 00010000:00010000:0.0:1787856757.654739:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856758.097973:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436317440:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098080:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098157:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436317952:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098190:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098213:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436318464:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098266:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098284:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436318976:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098331:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787856758.098336:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436317824:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098364:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098415:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436318336:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098455:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098474:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436318848:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098504:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098537:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436317568:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098563:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098581:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436318080:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098603:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098617:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436318592:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098638:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098657:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787856758.098663:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436317696:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098686:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098703:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436318208:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098724:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098739:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436318720:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098762:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.098797:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436317440 00000100:00100000:0.0:1787856758.098805:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436317440 00000100:00100000:0.0:1787856758.098864:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787856758.098875:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436317440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.098937:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436317440:12345-0@lo:400:kworker.0 Request processed in 63us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.098945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787856758.098984:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436317952 00000100:00100000:0.0:1787856758.098996:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436317952 00000100:00100000:0.0:1787856758.099015:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436317696 00000100:00100000:0.0:1787856758.099018:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436317696 00000100:00100000:0.0:1787856758.099032:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787856758.099038:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436317952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099077:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436317952:12345-0@lo:400:kworker.0 Request processed in 39us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.099083:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787856758.099097:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787856758.099103:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436317696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099137:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436317696:12345-0@lo:400:kworker.0 Request processed in 34us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.099142:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787856758.099161:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436317824 00000100:00100000:0.0:1787856758.099165:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436317824 00000100:00100000:0.0:1787856758.099185:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436318336 00000100:00100000:0.0:1787856758.099187:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436318336 00000100:00100000:0.0:1787856758.099241:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436317568 00000100:00100000:0.0:1787856758.099245:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436317568 00000100:00100000:0.0:1787856758.099259:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436318592 00000100:00100000:0.0:1787856758.099262:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436318592 00000100:00100000:0.0:1787856758.099273:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436318208 00000100:00100000:0.0:1787856758.099275:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436318208 00000100:00100000:0.0:1787856758.099286:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436318720 00000100:00100000:0.0:1787856758.099289:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436318720 00000100:00100000:0.0:1787856758.099306:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787856758.099312:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436317824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099346:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436317824:12345-0@lo:400:kworker.0 Request processed in 34us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.099363:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787856758.099378:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787856758.099385:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436318336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099414:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436318336:12345-0@lo:400:kworker.0 Request processed in 31us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.099420:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787856758.099444:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787856758.099450:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436317568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099477:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436317568:12345-0@lo:400:kworker.0 Request processed in 28us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.099483:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787856758.099495:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787856758.099501:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436318592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099528:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436318592:12345-0@lo:400:kworker.0 Request processed in 28us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.099534:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787856758.099545:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787856758.099551:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436318208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099579:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436318208:12345-0@lo:400:kworker.0 Request processed in 28us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.099585:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787856758.099596:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787856758.099602:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436318720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099629:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436318720:12345-0@lo:400:kworker.0 Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.099641:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1787856758.099671:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856758.099676:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856758.099712:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436317696:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099725:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436318208:0@lo:400:kworker.0 00010000:00080000:0.0:1787856758.099738:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ed680 x1874703436318720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856758.099749:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436318720:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099760:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436317568:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099770:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436318592:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099812:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436317824:0@lo:400:kworker.0 00010000:00080000:0.0:1787856758.099824:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ec3c0 x1874703436318336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856758.099834:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436318336:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099844:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436317440:0@lo:400:kworker.0 00000100:00100000:0.0:1787856758.099857:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436317952:0@lo:400:kworker.0 00000100:00100000:1.0:1787856758.100039:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436318464 00000100:00100000:1.0:1787856758.100044:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436318464 00000100:00100000:1.0:1787856758.100080:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436318976 00000100:00100000:1.0:1787856758.100084:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436318976 00000100:00100000:1.0:1787856758.100098:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436318848 00000100:00100000:1.0:1787856758.100100:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436318848 00000100:00100000:1.0:1787856758.100113:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436318080 00000100:00100000:1.0:1787856758.100116:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436318080 00000100:00100000:1.0:1787856758.100132:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787856758.100139:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436318464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856758.100188:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436318464:12345-0@lo:400:kworker.0 Request processed in 50us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856758.100195:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787856758.100207:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787856758.100241:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436318976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856758.100274:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436318976:12345-0@lo:400:kworker.0 Request processed in 61us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856758.100280:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787856758.100292:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787856758.100298:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436318848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856758.100327:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436318848:12345-0@lo:400:kworker.0 Request processed in 30us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856758.100346:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787856758.100359:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787856758.100365:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436318080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856758.100398:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436318080:12345-0@lo:400:kworker.0 Request processed in 34us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856758.100404:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787856758.100449:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856758.100461:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436319104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856758.100503:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856758.100543:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436319104 00000100:00100000:1.0:1787856758.100547:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436319104 00000100:00100000:1.0:1787856758.100574:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787856758.100581:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436319104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856758.100608:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856758.100647:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436319104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856758.100654:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787856758.100673:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787856758.100677:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787856758.100696:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8282580 x1874703436319104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856758.100715:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436319104:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787856758.100743:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81bcb40 x1874703436318848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856758.100753:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436318848:0@lo:400:kworker.0 00010000:00080000:1.0:1787856758.100777:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ee580 x1874703436318464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856758.100785:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436318464:0@lo:400:kworker.0 00010000:00080000:1.0:1787856758.100795:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81bed00 x1874703436318976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856758.100802:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436318976:0@lo:400:kworker.0 00000100:00100000:1.0:1787856758.101087:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436319232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856758.101114:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856758.101261:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436319232 00000100:00100000:3.0:1787856758.101267:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436319232 00000100:00100000:3.0:1787856758.101300:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787856758.101309:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8282580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436319232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856758.101322:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856758.101360:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8282580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436319232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856758.101366:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1787856758.101396:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066007c2580 x1874703436319232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856758.101409:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436319232:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787856758.102717:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ef0c0 x1874703436318080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856758.102734:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436318080:0@lo:400:kworker.0 00000100:00100000:1.0:1787856758.117344:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436319360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856758.117464:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856758.117587:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436319360 00000100:00100000:0.0:1787856758.117612:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436319360 00000100:00100000:0.0:1787856758.117732:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787856758.117744:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436319360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856758.117783:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856758.117849:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436319360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856758.117858:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1787856758.117946:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81bf480 x1874703436319360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856758.117970:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436319360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856758.618540:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436319488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856758.619756:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856758.621283:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436319488 00000100:00100000:2.0:1787856758.621310:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436319488 00000100:00100000:2.0:1787856758.621394:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787856758.621418:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436319488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856758.621462:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856758.621572:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436319488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856758.621580:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1787856758.622724:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c82803c0 x1874703436319488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856758.622757:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436319488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856758.674204:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856759.121879:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436319616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856759.121979:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856759.122109:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436319616 00000100:00100000:3.0:1787856759.122119:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436319616 00000100:00100000:3.0:1787856759.122183:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787856759.122205:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436319616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856759.122281:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856759.122337:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436319616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856759.122345:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787856759.122598:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436319616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856759.633507:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436319744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856759.633607:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856759.634023:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436319744 00000100:00100000:1.0:1787856759.634035:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436319744 00000100:00100000:1.0:1787856759.634112:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787856759.634123:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436319744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856759.634178:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856759.634647:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436319744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 525us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856759.634656:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787856759.634729:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436319744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787856759.702526:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787856760.496542:0:13163:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff33daaa90 20000000:00000080:0.0:1787856760.496568:0:13163:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9064c82b7000 uarg=0000000000000000 20000000:01000000:0.0:1787856760.496625:0:13163:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787856760.496633:0:13163:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787856760.496638:0:13163:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787856760.497254:0:13164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787856760.497426:0:13163:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787856760.503547:0:13163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787856760.503679:0:13163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503706:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503715:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503723:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503729:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503741:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503775:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503784:0:13163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503841:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.503861:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 12 pid: 6491 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.503878:0:13163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436319872:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856760.504210:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.504914:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 12 pid: 6490 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.504940:0:13163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320000:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856760.505069:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.505079:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 23 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.505089:0:13163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320128:0@lo:104: 00000100:00100000:0.0:1787856760.505135:0:13163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856760.505189:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.505197:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 23 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.505206:0:13163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320256:0@lo:104: 00000100:00100000:0.0:1787856760.505261:0:13163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856760.505295:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.505303:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 23 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.505312:0:13163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ef0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320384:0@lo:104: 00000100:00100000:0.0:1787856760.505332:0:13163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856760.505348:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.505356:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 23 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.505364:0:13163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320512:0@lo:104: 00000100:00100000:0.0:1787856760.505381:0:13163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856760.505392:0:13163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856760.505554:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436320128 00000100:00100000:2.0:1787856760.505563:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436320128 00000100:00100000:2.0:1787856760.505611:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436320256 00000100:00100000:2.0:1787856760.505615:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436320256 00000100:00100000:2.0:1787856760.505626:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436320384 00000100:00100000:2.0:1787856760.505628:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436320384 00000100:00100000:2.0:1787856760.505636:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436320512 00000100:00100000:2.0:1787856760.505638:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436320512 00000100:00100000:2.0:1787856760.505651:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787856760.505661:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+6:13163:x1874703436320128:12345-0@lo:104: 00010000:00010000:2.0:1787856760.505676:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.505748:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787856760.505755:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+6:13163:x1874703436320128:12345-0@lo:104: Request processed in 96us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856760.505774:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787856760.505793:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787856760.505799:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:13163:x1874703436320256:12345-0@lo:104: 00010000:00010000:2.0:1787856760.505807:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.505844:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787856760.505849:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+5:13163:x1874703436320256:12345-0@lo:104: Request processed in 51us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856760.505855:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787856760.505866:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787856760.505872:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:13163:x1874703436320384:12345-0@lo:104: 00010000:00010000:2.0:1787856760.505879:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.505911:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787856760.505917:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+4:13163:x1874703436320384:12345-0@lo:104: Request processed in 45us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856760.505981:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787856760.505993:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787856760.505999:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:13163:x1874703436320512:12345-0@lo:104: 00010000:00010000:2.0:1787856760.506007:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506033:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787856760.506038:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c911024a-9030-4ea8-a782-9255ee9580a7+3:13163:x1874703436320512:12345-0@lo:104: Request processed in 40us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856760.506051:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787856760.506071:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787856760.506078:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506086:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37c600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856760.506091:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506101:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856760.506109:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856760.506115:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787856760.506147:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506154:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856760.506179:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506187:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065cd37c600/0xc25410d92a3c3b29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506203:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787856760.506206:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506250:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065cd37d800 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856760.506253:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506260:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856760.506266:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856760.506271:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787856760.506286:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506292:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856760.506299:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506305:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065cd37d800/0xc25410d92a3c3b1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506317:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787856760.506320:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506325:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fee00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856760.506328:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506344:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856760.506351:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856760.506357:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787856760.506372:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506378:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856760.506393:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.506401:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.506529:0:13163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320128:0@lo:104: 00000100:00100000:0.0:1787856760.506539:0:13163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320256:0@lo:104: 00000100:00100000:0.0:1787856760.506546:0:13163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ef0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320384:0@lo:104: 00000100:00100000:0.0:1787856760.506553:0:13163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320512:0@lo:104: 00010000:00010000:1.0:1787856760.506746:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856760.506754:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.506761:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856760.506764:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.506771:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856760.506776:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856760.506782:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787856760.506800:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.506815:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856760.506823:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.506829:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffc00/0xc25410d92a3c3aff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b06 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.506842:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856760.506844:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856760.506846:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856760.506853:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856760.506866:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436320768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856760.506913:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787856760.506998:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856760.507000:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856760.507002:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856760.507014:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436320640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856760.507049:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436320896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856760.507189:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856760.507342:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436321024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856760.507369:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436320768 00000100:00100000:0.0:1787856760.507376:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436320768 00010000:00010000:0.0:1787856760.507423:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 24 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.507447:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436320640 00000100:00100000:0.0:1787856760.507451:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436320640 00000100:00100000:2.0:1787856760.507452:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787856760.507461:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c911024a-9030-4ea8-a782-9255ee9580a7+25:3624:x1874703436320768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856760.507466:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 25 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.507483:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1787856760.507487:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787856760.507489:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+25:3623:x1874703436320640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787856760.507494:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 25 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.507496:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856760.507499:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 25 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.507509:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 25 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856760.507543:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856760.507556:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787856760.507565:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1787856760.507572:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856760.507805:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436320896 00000100:00100000:1.0:1787856760.507809:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436320896 00010000:00010000:1.0:1787856760.507828:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 26 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856760.507843:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787856760.507850:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436321024 00000100:00100000:1.0:1787856760.507852:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436321024 00010000:00010000:1.0:1787856760.507863:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 27 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856760.507872:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787856760.507878:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787856760.507883:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+27:3625:x1874703436320896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856760.507899:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856760.507903:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 27 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856760.508041:0:13165:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:3.0:1787856760.508050:0:13165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00000100:00100000:3.0:1787856760.508362:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787856760.508370:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8281e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+27:3626:x1874703436321024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856760.508382:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856760.508387:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 27 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.511096:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 27 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.511420:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 27 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.511438:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076a200/0xc25410d92a3c3b14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3b0d expref: 27 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.511465:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856760.511580:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c911024a-9030-4ea8-a782-9255ee9580a7+26:3625:x1874703436320896:12345-0@lo:103:ldlm_bl.0 Request processed in 3695us (4035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856760.511591:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787856760.511680:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436320896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787856760.511765:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076b600/0xc25410d92a3c3b22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3b1b expref: 25 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.511776:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856760.511856:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076b200/0xc25410d92a3c3b30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3b29 expref: 24 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.511869:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856760.511911:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436320640:12345-0@lo:103:ldlm_bl.0 Request processed in 4421us (4720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856760.511919:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787856760.511983:0:13163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436319872:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856760.512032:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c911024a-9030-4ea8-a782-9255ee9580a7+22:3624:x1874703436320768:12345-0@lo:103:ldlm_bl.0 Request processed in 4571us (5119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856760.512039:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787856760.512109:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436320768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856760.512137:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436320640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856760.512691:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 21 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856760.512706:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076a400/0xc25410d92a3c3b06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3aff expref: 21 pid: 6488 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856760.512715:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856760.512884:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856760.512955:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8281e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+20:3626:x1874703436321024:12345-0@lo:103:ldlm_bl.0 Request processed in 4586us (5381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856760.512986:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787856760.513010:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426800128 00000100:00100000:0.0:1787856760.513018:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426800128 00010000:00010000:0.0:1787856760.513058:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 13 pid: 6491 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.513087:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:0.0:1787856760.513099:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426800128:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856760.513116:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856760.513122:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 13 pid: 6491 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.513131:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 13 pid: 6491 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.513140:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3b4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e85 expref: 13 pid: 6491 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856760.513148:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856760.513180:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f992ea53-5038-46c1-bdd9-a3b884b74351+12:2401:x1874703426800128:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856760.513184:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1787856760.513298:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436321024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856760.515081:0:13163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1874703436320000:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856760.515130:0:13163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856760.522008:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856760.525540:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426800256 00000100:00100000:2.0:1787856760.525563:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426800256 00010000:00010000:2.0:1787856760.525630:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 12 pid: 6490 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856760.525698:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1787856760.525709:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f992ea53-5038-46c1-bdd9-a3b884b74351+12:2402:x1874703426800256:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856760.525731:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856760.525739:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 12 pid: 6490 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525753:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 12 pid: 6490 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525778:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274ae00/0xc25410d92a3c3b37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e46 expref: 12 pid: 6490 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525812:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525841:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525863:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525871:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525878:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525885:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525892:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856760.525896:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.525905:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.526603:0:13163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856760.526615:0:13163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.526754:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.526765:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ff200/0xc25410d92a3c3b6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856760.526796:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856760.527038:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f992ea53-5038-46c1-bdd9-a3b884b74351+11:2402:x1874703426800256:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1325us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856760.527051:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00010000:00010000:2.0:1787856760.727010:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856761.307315:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856761.307391:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856761.307437:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856761.307479:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856761.310510:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426800384 00000100:00100000:0.0:1787856761.310510:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426800640 00000100:00100000:3.0:1787856761.310531:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426800384 00000100:00100000:0.0:1787856761.310538:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426800640 00000100:00100000:0.0:1787856761.310629:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426800512 00000100:00100000:0.0:1787856761.310633:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426800512 00000100:00100000:0.0:1787856761.310653:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426800768 00000100:00100000:0.0:1787856761.310657:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426800768 00000100:00100000:0.0:1787856761.310698:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:2.0:1787856761.310875:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:2.0:1787856761.310888:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426800512:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856761.311013:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426800512:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 128us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856761.311021:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:2.0:1787856761.311049:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:2.0:1787856761.311134:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426800768:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:1.0:1787856761.311297:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856761.311303:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856761.311368:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426800768:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 312us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856761.311376:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:0.0:1787856761.312434:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426800640:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856761.312439:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 199 00000100:00100000:3.0:1787856761.312449:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426800384:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856761.312557:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426800640:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 1849us (5165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856761.312566:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:3.0:1787856761.314132:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426800384:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 1671us (6830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856761.314532:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 199 10000000:01000000:3.0:1787856761.553376:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787856761.553395:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe85b800 from 7 10000000:01000000:3.0:1787856761.553412:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787856761.553481:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856761.553495:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856761.553507:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856761.553541:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787856761.553653:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856761.553734:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe6c5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856761.553866:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436321152 00000100:00100000:0.0:1787856761.553876:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436321152 00000100:00100000:0.0:1787856761.553949:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787856761.553960:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436321152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856761.553978:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856761.553995:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3b76 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.554026:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.554040:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.554051:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ffc00, rc 0) 00000100:00100000:0.0:1787856761.554108:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436321152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856761.554117:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787856761.554596:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856761.554628:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856761.554638:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856761.554732:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856761.554772:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856761.554808:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c714c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856761.554940:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436321280 00000100:00100000:0.0:1787856761.554965:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436321280 00000100:00100000:0.0:1787856761.555116:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787856761.555126:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436321280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856761.555294:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436321280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856761.555302:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787856761.555387:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856761.555436:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856761.555492:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856761.555861:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c714c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787856761.555957:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436321408 00000100:00100000:1.0:1787856761.555963:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436321408 00000100:00100000:1.0:1787856761.555997:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787856761.556015:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436321408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.556133:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436321408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856761.556140:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787856761.556248:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787856761.557475:0:13185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787856761.557746:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787856761.557774:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856761.557785:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.557798:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856761.557809:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856761.557812:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe6d5000 from 7 10000000:01000000:1.0:1787856761.557816:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856761.557862:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.557871:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.557883:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856761.557910:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.557978:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856761.558029:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787856761.558141:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436321536 00000100:00100000:2.0:1787856761.558148:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436321536 00000100:00100000:2.0:1787856761.558192:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787856761.558203:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436321536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856761.558232:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856761.558247:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3b84 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856761.558275:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856761.558287:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856761.558298:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076be00, rc 0) 00000100:00100000:2.0:1787856761.558358:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436321536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856761.558365:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787856761.558587:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856761.558603:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.558707:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856761.558791:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.558822:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856761.558853:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787856761.558925:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436321664 00000100:00100000:0.0:1787856761.558931:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436321664 00000100:00100000:0.0:1787856761.558967:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787856761.558974:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436321664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856761.559096:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436321664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856761.559103:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787856761.559181:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.559253:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.559301:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856761.559318:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce6300 going to sleep for 11 seconds 00000100:00100000:1.0:1787856761.559472:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436321792 00000100:00100000:1.0:1787856761.559476:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436321792 00000100:00100000:1.0:1787856761.559499:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787856761.559505:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436321792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.559591:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436321792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856761.559598:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787856761.559723:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787856761.560751:0:13186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787856761.561168:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787856761.561202:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787856761.561498:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.561513:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856761.561525:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787856761.561529:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065f7199800 from 7 10000000:01000000:0.0:1787856761.561532:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787856761.561579:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.561587:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.561696:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856761.561725:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787856761.561805:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856761.561892:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787856761.561966:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436321920 00000100:00100000:1.0:1787856761.561975:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436321920 00000100:00100000:1.0:1787856761.562064:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787856761.562075:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436321920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856761.562093:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856761.562116:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3b92 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.562143:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.562155:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.562165:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938a00, rc 0) 00000100:00100000:1.0:1787856761.562295:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436321920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856761.562303:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787856761.562591:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436321920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856761.562608:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.562689:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856761.562773:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856761.562806:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856761.562841:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787856761.562901:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436322048 00000100:00100000:3.0:1787856761.562907:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436322048 00000100:00100000:3.0:1787856761.562976:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787856761.562998:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436322048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856761.563158:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436322048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856761.563166:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787856761.563324:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856761.563498:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856761.563549:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856761.563579:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787856761.563703:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436322176 00000100:00100000:3.0:1787856761.563709:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436322176 00000100:00100000:3.0:1787856761.563744:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787856761.563752:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436322176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856761.563849:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436322176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856761.563856:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787856761.563965:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787856761.565044:0:13187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787856761.565488:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787856761.565529:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856761.565542:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.565553:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856761.565566:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856761.565570:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065d3be8000 from 7 10000000:01000000:1.0:1787856761.565574:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856761.565688:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.565697:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.565711:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856761.565754:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.565827:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856761.565870:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856761.565945:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436322304 00000100:00100000:3.0:1787856761.565953:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436322304 00000100:00100000:3.0:1787856761.566005:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787856761.566015:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436322304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856761.566029:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856761.566045:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3ba0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856761.566072:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856761.566084:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856761.566094:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274a600, rc 0) 00000100:00100000:3.0:1787856761.566247:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436322304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856761.566263:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787856761.566854:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856761.566878:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.566900:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856761.567070:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.567111:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856761.567186:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856761.567527:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436322432 00000100:00100000:0.0:1787856761.567534:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436322432 00000100:00100000:0.0:1787856761.567626:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787856761.567636:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436322432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856761.567794:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436322432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856761.567802:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787856761.567870:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.567907:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856761.567961:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856761.568114:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856761.568178:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436322560 00000100:00100000:3.0:1787856761.568183:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436322560 00000100:00100000:3.0:1787856761.568208:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787856761.568248:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436322560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856761.568351:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436322560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856761.568358:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787856761.568496:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436322560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787856761.569243:0:13188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787856761.569323:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787856761.569345:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856761.569357:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856761.569367:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856761.747428:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856762.334705:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856762.335196:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426800896 00000100:00100000:3.0:1787856762.335206:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426800896 00000100:00100000:3.0:1787856762.335283:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 328 00000100:00100000:3.0:1787856762.335294:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+11:6174:x1874703426800896:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856762.335310:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856762.335327:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5eb6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856762.335355:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856762.335366:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856762.335388:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274ba00, rc 0) 00000100:00100000:3.0:1787856762.335494:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426800896:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 201us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856762.335502:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 328 00000100:00100000:2.0:1787856762.338934:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856762.338999:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426801024 00000100:00100000:1.0:1787856762.339008:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426801024 00000100:00100000:1.0:1787856762.339067:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 329 00000100:00100000:1.0:1787856762.339077:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426801024:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856762.339240:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426801024:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 164us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856762.339249:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 329 00000100:00100000:2.0:1787856762.351454:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856762.351597:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426801152 00000100:00100000:3.0:1787856762.351624:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426801152 00000100:00100000:3.0:1787856762.351970:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 330 00000100:00100000:3.0:1787856762.351983:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426801152:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856762.352194:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426801152:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 213us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856762.352202:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 330 00000100:00100000:3.0:1787856762.367186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856762.369162:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426801280 00000100:00100000:2.0:1787856762.369181:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426801280 00000100:00100000:2.0:1787856762.369746:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 331 00000100:00100000:2.0:1787856762.369893:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426801280:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856762.370048:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856762.370076:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ebd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856762.370118:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856762.370131:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856762.370141:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b400, rc 0) 00000100:00100000:2.0:1787856762.370311:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426801280:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 422us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856762.370321:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 331 00000100:00100000:2.0:1787856762.383292:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856762.383421:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426801408 00000100:00100000:1.0:1787856762.383435:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426801408 00000100:00100000:1.0:1787856762.383508:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 332 00000100:00100000:1.0:1787856762.383520:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426801408:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856762.383752:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426801408:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 233us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856762.383762:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 332 00000100:00100000:1.0:1787856762.389058:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856762.389274:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426801536 00000100:00100000:3.0:1787856762.389286:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426801536 00000100:00100000:3.0:1787856762.389349:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 333 00000100:00100000:3.0:1787856762.389360:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426801536:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856762.389625:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426801536:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 265us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856762.389961:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 333 00010000:00010000:1.0:1787856762.769904:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856763.220034:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856763.220064:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436322688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856763.220154:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856763.220274:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436322688 00000100:00100000:0.0:1787856763.220283:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436322688 00000100:00100000:0.0:1787856763.220353:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787856763.220367:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436322688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856763.220417:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856763.220470:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436322688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.220478:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787856763.220505:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856763.220544:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ec3c0 x1874703436322688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856763.220564:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436322688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856763.221968:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856763.221990:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436322816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856763.222059:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856763.222117:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436322816 00000100:00100000:0.0:1787856763.222124:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436322816 00000100:00100000:0.0:1787856763.222177:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787856763.222188:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436322816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856763.222234:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856763.222278:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436322816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.222285:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787856763.222307:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787856763.222333:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81ec3c0 x1874703436322816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856763.222351:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436322816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856763.224968:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436323072:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225057:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856763.225097:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436323584:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225127:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856763.225147:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436324096:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225170:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856763.225199:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787856763.225205:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436322944:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225256:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856763.225287:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436323456:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225338:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856763.225355:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436323968:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225377:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856763.225428:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436323072 00000100:00100000:2.0:1787856763.225436:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436323072 00000100:00100000:2.0:1787856763.225491:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436324096 00000100:00100000:2.0:1787856763.225495:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436324096 00000100:00100000:2.0:1787856763.225526:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436323968 00000100:00100000:2.0:1787856763.225529:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436323968 00000100:00100000:2.0:1787856763.225548:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787856763.225558:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8244b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436323072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225749:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8244b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436323072:12345-0@lo:400:kworker.0 Request processed in 192us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856763.225757:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787856763.225778:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787856763.225785:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436324096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225859:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436324096:12345-0@lo:400:kworker.0 Request processed in 75us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856763.225866:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787856763.225878:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787856763.225885:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436323968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.225913:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436323968:12345-0@lo:400:kworker.0 Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856763.225919:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787856763.225941:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436323584 00000100:00100000:2.0:1787856763.225945:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436323584 00000100:00100000:2.0:1787856763.225985:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787856763.226002:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436323584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.226037:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436323584:12345-0@lo:400:kworker.0 Request processed in 37us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856763.226044:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787856763.226069:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436322944 00000100:00100000:2.0:1787856763.226072:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436322944 00000100:00100000:2.0:1787856763.226100:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787856763.226106:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436322944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.226138:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436322944:12345-0@lo:400:kworker.0 Request processed in 32us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856763.226144:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787856763.226203:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436322944:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.226242:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436323968:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.226255:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436323072:0@lo:400:kworker.0 00010000:00080000:2.0:1787856763.226268:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5f0c0 x1874703436323584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856763.226279:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436323584:0@lo:400:kworker.0 00010000:00080000:2.0:1787856763.226289:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5f840 x1874703436324096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856763.226296:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436324096:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.226431:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436323456 00000100:00100000:0.0:1787856763.226436:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436323456 00000100:00100000:0.0:1787856763.226478:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787856763.226487:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436323456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.226534:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436323456:12345-0@lo:400:kworker.0 Request processed in 49us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.226542:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1787856763.226568:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856763.226573:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856763.226576:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856763.226589:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436323200:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.226647:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856763.226670:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436323712:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.226692:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856763.226711:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8247840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436324224:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.226736:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856763.226758:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787856763.226765:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe9acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436323328:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.226785:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856763.226804:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436323840:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.226838:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856763.226870:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436324224 00000100:00100000:0.0:1787856763.226874:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436324224 00000100:00100000:0.0:1787856763.226909:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787856763.226916:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436324224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.226952:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436324224:12345-0@lo:400:kworker.0 Request processed in 38us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.226959:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787856763.226980:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436323712 00000100:00100000:0.0:1787856763.226983:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436323712 00000100:00100000:0.0:1787856763.227008:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436323328 00000100:00100000:0.0:1787856763.227011:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436323328 00000100:00100000:0.0:1787856763.227028:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436323840 00000100:00100000:0.0:1787856763.227030:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436323840 00000100:00100000:0.0:1787856763.227046:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787856763.227052:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436323712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.227084:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436323712:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.227101:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787856763.227113:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787856763.227119:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436323328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.227145:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436323328:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.227151:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787856763.227161:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787856763.227167:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436323840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.227190:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436323840:12345-0@lo:400:kworker.0 Request processed in 23us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.227195:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:0.0:1787856763.227257:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856763.227260:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856763.227262:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856763.227271:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436323200 00000100:00100000:0.0:1787856763.227275:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436323200 00000100:00100000:0.0:1787856763.227293:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787856763.227299:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436323200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.227329:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436323200:12345-0@lo:400:kworker.0 Request processed in 30us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.227335:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787856763.227373:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436323328:0@lo:400:kworker.0 00010000:00080000:0.0:1787856763.227397:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5c000 x1874703436323840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856763.227407:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436323840:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.227425:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe9acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436323200:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.227434:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436323712:0@lo:400:kworker.0 00010000:00080000:0.0:1787856763.227443:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8247840 x1874703436324224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856763.227452:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8247840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436324224:0@lo:400:kworker.0 00000100:00100000:0.0:1787856763.227489:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436323456:0@lo:400:kworker.0 00000100:00100000:2.0:1787856763.229318:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436324352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856763.229408:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856763.229550:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436324352 00000100:00100000:0.0:1787856763.229559:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436324352 00000100:00100000:0.0:1787856763.229692:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787856763.229704:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436324352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856763.229731:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856763.230273:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436324352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 567us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856763.230282:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1787856763.233978:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81bf480 x1874703436324352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856763.234014:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436324352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856763.731090:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856763.731129:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436324480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856763.731198:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856763.731461:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436324480 00000100:00100000:1.0:1787856763.731470:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436324480 00000100:00100000:1.0:1787856763.731524:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787856763.731535:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436324480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856763.731558:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856763.731607:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436324480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856763.731615:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1787856763.732048:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8281a40 x1874703436324480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856763.732066:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436324480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787856763.805306:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856764.244404:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436324608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856764.244495:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856764.244777:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436324608 00000100:00100000:3.0:1787856764.244785:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436324608 00000100:00100000:3.0:1787856764.244838:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787856764.244848:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8281a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436324608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856764.244885:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856764.244936:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8281a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436324608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856764.244944:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787856764.244996:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436324608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856764.761884:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856764.761911:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436324736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856764.762000:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856764.762105:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436324736 00000100:00100000:1.0:1787856764.762113:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436324736 00000100:00100000:1.0:1787856764.762165:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787856764.762174:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436324736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856764.762208:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856764.762285:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436324736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856764.762293:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787856764.762347:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436324736:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787856764.817428:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787856765.110666:0:13363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787856765.841571:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856766.431422:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856766.431481:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856766.431511:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856766.431568:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856766.431579:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426801664 00000100:00100000:1.0:1787856766.431598:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426801664 00000100:00100000:3.0:1787856766.431612:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856766.431650:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426801920 00000100:00100000:2.0:1787856766.431656:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426801920 00000100:00100000:1.0:1787856766.431681:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 335 00000100:00100000:1.0:1787856766.431692:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426801664:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856766.431698:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426802176 00000100:00100000:2.0:1787856766.431701:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426802176 00000100:00100000:2.0:1787856766.431722:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426801792 00000100:00100000:2.0:1787856766.431725:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426801792 00000100:00100000:2.0:1787856766.431739:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:2.0:1787856766.431745:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426801920:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856766.431784:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426801664:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 94us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856766.431788:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426801920:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856766.431792:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 335 00000100:00100000:2.0:1787856766.431794:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:2.0:1787856766.431809:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:2.0:1787856766.431814:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426802176:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856766.431837:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426802176:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856766.431843:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:2.0:1787856766.431853:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00100000:2.0:1787856766.431858:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426801792:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856766.431956:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426801792:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 97us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856766.431963:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00080000:2.0:1787856766.432005:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856766.432009:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856766.438649:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426802048 00000100:00100000:0.0:1787856766.438665:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426802048 00000100:00100000:2.0:1787856766.438795:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:2.0:1787856766.438824:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426802048:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856766.438956:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426802048:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 146us (7346us total) trans 0 rc 0/0 00000100:00080000:3.0:1787856766.439025:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856766.441646:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 209 00010000:00010000:2.0:1787856766.865494:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856767.890366:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856768.337440:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856768.337465:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436325120:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.337541:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856768.337552:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436325504:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.337593:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856768.337606:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436324864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856768.337619:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436326016:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.337639:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856768.337654:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856768.337683:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436326528:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.337688:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436325632:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.337708:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856768.337741:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856768.337761:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436325248:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.337778:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436326144:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.337794:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856768.337811:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856768.337821:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436325760:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.337852:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436324864 00000100:00100000:0.0:1787856768.337859:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436324864 00000100:00100000:0.0:1787856768.337908:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787856768.337917:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436324864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856768.337945:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856768.337984:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436324864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.337992:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787856768.338014:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436326016 00000100:00100000:0.0:1787856768.338019:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436326016 00000100:00100000:0.0:1787856768.338037:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436326528 00000100:00100000:0.0:1787856768.338040:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436326528 00000100:00100000:0.0:1787856768.338051:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436325632 00000100:00100000:0.0:1787856768.338054:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436325632 00000100:00100000:0.0:1787856768.338067:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787856768.338073:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436326016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338107:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436326016:12345-0@lo:400:kworker.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.338114:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787856768.338124:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856768.338129:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787856768.338136:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436326528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.338151:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436326272:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338186:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7062940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436326528:12345-0@lo:400:kworker.0 Request processed in 50us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856768.338190:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856768.338198:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787856768.338238:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787856768.338242:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787856768.338250:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436324992:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338252:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436325632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.338291:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856768.338297:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436325632:12345-0@lo:400:kworker.0 Request processed in 46us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.338305:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787856768.338323:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436325376:0@lo:400:kworker.0 00000100:00080000:0.0:1787856768.338331:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856768.338364:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787856768.338366:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856768.338380:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436325120 00000100:00100000:0.0:1787856768.338385:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436325120 00000100:00100000:2.0:1787856768.338386:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436325888:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338407:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436326144 00000100:00100000:0.0:1787856768.338411:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436326144 00000100:00100000:0.0:1787856768.338430:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436325760 00000100:00100000:0.0:1787856768.338432:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436325760 00000100:00100000:2.0:1787856768.338438:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856768.338449:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436326272 00000100:00100000:0.0:1787856768.338454:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436326272 00000100:00100000:2.0:1787856768.338459:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436326400:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338466:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436325376 00000100:00100000:0.0:1787856768.338470:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436325376 00000100:00100000:0.0:1787856768.338487:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436325888 00000100:00100000:2.0:1787856768.338491:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856768.338492:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436325888 00000100:00100000:0.0:1787856768.338513:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787856768.338520:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8247840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436325120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.338531:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787856768.338542:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436326144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338555:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8247840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436325120:12345-0@lo:400:kworker.0 Request processed in 35us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.338563:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787856768.338579:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787856768.338588:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436326144:12345-0@lo:400:kworker.0 Request processed in 47us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.338589:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436325760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.338602:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787856768.338619:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787856768.338628:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7062d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436326272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338647:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436325760:12345-0@lo:400:kworker.0 Request processed in 61us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.338655:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787856768.338678:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7062d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436326272:12345-0@lo:400:kworker.0 Request processed in 51us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.338681:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787856768.338691:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787856768.338693:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7061e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436325376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.338714:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787856768.338724:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436325888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338731:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7061e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436325376:12345-0@lo:400:kworker.0 Request processed in 40us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.338738:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:0.0:1787856768.338754:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856768.338756:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856768.338762:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436326400 00000100:00100000:0.0:1787856768.338765:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436326400 00000100:00100000:0.0:1787856768.338787:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787856768.338792:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436326400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338819:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436326400:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.338825:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787856768.338840:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856768.338863:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5c000 x1874703436325632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856768.338876:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436325632:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338887:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436326144:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338896:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436325120:0@lo:400:kworker.0 00010000:00080000:0.0:1787856768.338905:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81bf480 x1874703436324864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856768.338917:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436324864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856768.338948:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436325376:0@lo:400:kworker.0 00010000:00080000:0.0:1787856768.338967:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70603c0 x1874703436326400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856768.338975:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436326400:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.338985:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436325760:0@lo:400:kworker.0 00010000:00080000:0.0:1787856768.338997:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c70ef0c0 x1874703436326272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856768.339006:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436326272:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.339017:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436325888:12345-0@lo:400:kworker.0 Request processed in 293us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856768.339026:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00010000:00080000:0.0:1787856768.339034:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5f0c0 x1874703436325888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856768.339043:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436325888:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.339057:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436325504 00000100:00100000:2.0:1787856768.339062:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436325504 00000100:00100000:2.0:1787856768.339084:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436325248 00000100:00100000:2.0:1787856768.339088:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436325248 00010000:00080000:0.0:1787856768.339099:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5da40 x1874703436326016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856768.339107:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787856768.339112:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436326016:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.339119:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436325504:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787856768.339130:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7063840 x1874703436326528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856768.339138:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436326528:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.339164:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436325504:12345-0@lo:400:kworker.0 Request processed in 47us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856768.339164:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436325504:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.339180:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787856768.339197:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787856768.339204:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436325248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.339268:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436325248:12345-0@lo:400:kworker.0 Request processed in 64us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856768.339275:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787856768.339633:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436324992 00000100:00100000:1.0:1787856768.339639:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436324992 00000100:00100000:1.0:1787856768.339679:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787856768.339686:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436324992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856768.339730:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436324992:12345-0@lo:400:kworker.0 Request processed in 45us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856768.339749:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787856768.340057:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856768.340068:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436326656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856768.340101:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856768.340143:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436326656 00000100:00100000:3.0:1787856768.340147:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436326656 00000100:00100000:3.0:1787856768.340183:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787856768.340190:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7925a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436326656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856768.340209:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856768.340261:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7925a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436326656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856768.340267:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1787856768.340293:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7ab83c0 x1874703436326656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856768.340308:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436326656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856768.340579:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856768.341100:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436324992:0@lo:400:kworker.0 00000100:00100000:0.0:1787856768.341117:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436325248:0@lo:400:kworker.0 00000100:00100000:2.0:1787856768.343005:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436326784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856768.343081:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856768.346563:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436326784 00000100:00100000:1.0:1787856768.346578:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436326784 00000100:00100000:1.0:1787856768.346652:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787856768.346663:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436326784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856768.346691:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856768.346783:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436326784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856768.346790:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1787856768.346960:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8283480 x1874703436326784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856768.346982:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436326784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856768.849548:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856768.849600:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436326912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856768.849669:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856768.850105:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436326912 00000100:00100000:3.0:1787856768.850112:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436326912 00000100:00100000:3.0:1787856768.850167:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787856768.850175:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436326912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856768.850197:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856768.850277:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436326912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856768.850285:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1787856768.850519:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c82830c0 x1874703436326912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856768.850539:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436326912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856768.919750:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856769.362369:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c79243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436327040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856769.362452:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856769.371300:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436327040 00000100:00100000:2.0:1787856769.371317:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436327040 00000100:00100000:2.0:1787856769.371386:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787856769.371398:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436327040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787856769.371435:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787856769.371524:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436327040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (9069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856769.371534:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787856769.371686:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c79243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436327040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856769.880381:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856769.880406:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436327168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856769.880476:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856769.880540:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436327168 00000100:00100000:2.0:1787856769.880548:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436327168 00000100:00100000:2.0:1787856769.880605:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787856769.880614:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436327168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856769.880645:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787856769.880690:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436327168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856769.880697:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787856769.880741:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436327168:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787856769.937424:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856770.961911:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856771.548451:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856771.548528:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856771.548553:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856771.548572:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856771.548591:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856771.548755:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426802432 00000100:00100000:1.0:1787856771.548765:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426802432 00000100:00100000:1.0:1787856771.548819:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426802560 00000100:00100000:1.0:1787856771.548822:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426802560 00000100:00100000:1.0:1787856771.548835:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426802688 00000100:00100000:1.0:1787856771.548838:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426802688 00000100:00100000:1.0:1787856771.548852:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426802816 00000100:00100000:1.0:1787856771.548854:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426802816 00000100:00100000:1.0:1787856771.548871:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:1.0:1787856771.548881:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426802432:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856771.548982:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426802432:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 102us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856771.548990:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:1.0:1787856771.549007:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:1.0:1787856771.549014:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426802560:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856771.549051:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426802560:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 37us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856771.549057:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:1.0:1787856771.549081:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:1.0:1787856771.549089:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426802688:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856771.549113:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426802688:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856771.549120:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:1.0:1787856771.549142:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:1.0:1787856771.549148:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426802816:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856771.549170:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426802816:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856771.549176:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00080000:0.0:1787856771.550529:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856771.550535:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856771.550638:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426802304 00000100:00100000:2.0:1787856771.550644:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426802304 00000100:00100000:1.0:1787856771.550814:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 337 00000100:00100000:1.0:1787856771.550823:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426802304:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856771.550877:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426802304:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 55us (2435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856771.550884:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 337 00010000:00010000:1.0:1787856771.986496:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787856772.159609:0:13512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:52:50 (1787856770) === 00000100:00100000:3.0:1787856772.720692:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856772.720736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856772.720761:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426802944 00000100:00100000:1.0:1787856772.720772:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426802944 00000100:00100000:0.0:1787856772.720867:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426803072 00000100:00100000:0.0:1787856772.720872:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426803072 00000100:00100000:0.0:1787856772.720914:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:0.0:1787856772.720924:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:898e91b3-529b-44bc-a821-726bff6c71d4+7:10493:x1874703426803072:12345-192.168.202.6@tcp:700:mkdir.0 00000100:00100000:0.0:1787856772.721005:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:898e91b3-529b-44bc-a821-726bff6c71d4+7:10493:x1874703426803072:12345-192.168.202.6@tcp:700:mkdir.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856772.721012:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1787856772.721536:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:1.0:1787856772.721545:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426802944:12345-192.168.202.6@tcp:41:mkdir.0 00000004:00000024:1.0:1787856772.721570:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856772.721638:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426802944:12345-192.168.202.6@tcp:41:mkdir.0 Request processed in 95us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856772.721645:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1787856772.732561:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856772.732661:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426803328 00000100:00100000:0.0:1787856772.732671:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426803328 00000100:00100000:0.0:1787856772.732735:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:0.0:1787856772.732745:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:10493:x1874703426803328:12345-192.168.202.6@tcp:36:mkdir.0 00010000:00010000:0.0:1787856772.732801:0:9124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856772.732831:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3a5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e31 expref: 6 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.732850:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c793e300) 00010000:00010000:0.0:1787856772.732862:0:9124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856772.732945:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.732976:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.732986:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.732999:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733006:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733013:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733708:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733720:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733727:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856772.733740:0:9124:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f812e7cb reply state 00000000e861f9bf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733750:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733755:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9064c7956d00) 00010000:00010000:0.0:1787856772.733763:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856772.733767:0:9124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787856772.733772:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787856772.733779:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733786:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733792:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733797:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856772.733801:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733809:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733818:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7956200) 00010000:00010000:0.0:1787856772.733820:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856772.733824:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733830:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3bbc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856772.733844:0:9124:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f812e7cb reply state 00000000e861f9bf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733851:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.733868:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9064c7956400) 00010000:00010000:0.0:1787856772.733870:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856772.733872:0:9124:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787856772.733966:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+7:10493:x1874703426803328:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 1219us (1412us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787856772.733974:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:0.0:1787856772.745504:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856772.745613:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426803456 00000100:00100000:2.0:1787856772.745622:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426803456 00000100:00100000:2.0:1787856772.745745:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:2.0:1787856772.745766:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:10494:x1874703426803456:12345-192.168.202.6@tcp:101:chmod.0 00010000:00010000:2.0:1787856772.745791:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856772.745818:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ec4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.745891:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a400/0xc25410d92a3c3bd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.745906:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a400/0xc25410d92a3c3bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.745919:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a400/0xc25410d92a3c3bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856772.745967:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787856772.745984:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856772.746021:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a400/0xc25410d92a3c3bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.746047:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ec4 expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.746080:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a400/0xc25410d92a3c3bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ec4 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.746089:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6100) 00010000:00010000:2.0:1787856772.746092:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856772.746096:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a400, rc 0) 00000100:00100000:2.0:1787856772.746211:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:10494:x1874703426803456:12345-192.168.202.6@tcp:101:chmod.0 Request processed in 456us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856772.746266:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:1.0:1787856772.748967:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856772.749038:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426803712 00000100:00100000:2.0:1787856772.749047:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426803712 00000100:00100000:2.0:1787856772.749105:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:2.0:1787856772.749120:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+8:10494:x1874703426803712:12345-192.168.202.6@tcp:36:chmod.0 00010000:00010000:2.0:1787856772.749170:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856772.749192:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a400/0xc25410d92a3c3bd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ec4 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.749208:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6100) 00010000:00010000:2.0:1787856772.749238:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856772.749259:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.749315:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.749324:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856772.749503:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2f35f8c reply state 00000000076eee16 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.749526:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.749532:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6d00) 00010000:00010000:2.0:1787856772.749535:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787856772.749537:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787856772.749543:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787856772.749613:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+9:10494:x1874703426803712:12345-192.168.202.6@tcp:36:chmod.0 Request processed in 494us (654us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787856772.749621:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1787856772.798708:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856772.798839:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426803840 00000100:00100000:0.0:1787856772.798853:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426803840 00000100:00100000:0.0:1787856772.798928:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:0.0:1787856772.798938:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+9:10495:x1874703426803840:12345-192.168.202.6@tcp:101:chown.0 00010000:00010000:0.0:1787856772.798971:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856772.798992:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3be6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ecb expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.799058:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3bed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.799071:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3bed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.799083:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3bed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856772.799468:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787856772.799474:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856772.799514:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3bed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.799565:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3be6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ecb expref: 11 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.799589:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3bed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ecb expref: 10 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.799597:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6d00) 00010000:00010000:0.0:1787856772.799600:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787856772.799604:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff200, rc 0) 00000100:00100000:0.0:1787856772.799714:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+10:10495:x1874703426803840:12345-192.168.202.6@tcp:101:chown.0 Request processed in 776us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856772.799722:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1787856772.806777:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856772.806902:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426803968 00000100:00100000:2.0:1787856772.806915:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426803968 00000100:00100000:2.0:1787856772.807005:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:2.0:1787856772.807017:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8281e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+10:10495:x1874703426803968:12345-192.168.202.6@tcp:101:chown.0 00010000:00010000:2.0:1787856772.807045:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856772.807072:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a400/0xc25410d92a3c3bf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ed2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807173:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807248:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807267:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807284:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807303:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807310:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807603:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c3c09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807613:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c3c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807621:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c3c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856772.807681:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787856772.807686:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856772.807714:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c3c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807729:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807747:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807755:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807762:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856772.807768:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807777:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807791:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6d00) 00010000:00010000:2.0:1787856772.807795:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856772.807801:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807808:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3bfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807825:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807832:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807838:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807843:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856772.807853:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807860:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807869:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9064c7956400) 00010000:00010000:2.0:1787856772.807872:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856772.807874:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807881:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3c02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807918:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a400/0xc25410d92a3c3bf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ed2 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807932:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c3c09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ed2 expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856772.807940:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9064c7956d00) 00010000:00010000:2.0:1787856772.808530:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856772.808537:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076ba00, rc 0) 00000100:00100000:2.0:1787856772.808641:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8281e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+11:10495:x1874703426803968:12345-192.168.202.6@tcp:101:chown.0 Request processed in 1623us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856772.808652:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:1.0:1787856772.815566:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856772.815654:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426804096 00000100:00100000:3.0:1787856772.815664:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426804096 00000100:00100000:3.0:1787856772.815722:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1787856772.815731:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8281680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:898e91b3-529b-44bc-a821-726bff6c71d4+11:10495:x1874703426804096:12345-192.168.202.6@tcp:900:chown.0 00000100:00100000:3.0:1787856772.815875:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8281680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:898e91b3-529b-44bc-a821-726bff6c71d4+11:10495:x1874703426804096:12345-192.168.202.6@tcp:900:chown.0 Request processed in 144us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856772.815883:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1787856772.828857:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856772.828980:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426804352 00000100:00100000:0.0:1787856772.828990:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426804352 00000100:00100000:0.0:1787856772.829051:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1787856772.829062:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+11:10495:x1874703426804352:12345-192.168.202.6@tcp:36:chown.0 00010000:00010000:0.0:1787856772.829114:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856772.829139:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c3c09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ed2 expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.829158:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9064c7956d00) 00010000:00010000:0.0:1787856772.829163:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856772.829186:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.829198:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.829284:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787856772.833188:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1787856772.836458:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007065297d reply state 00000000ce9e8ade transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.836500:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.836510:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9064c7956d00) 00010000:00010000:0.0:1787856772.836514:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787856772.836519:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787856772.836532:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1787856772.836645:0:6498:0:(ldlm_lib.c:3492:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787856772.836670:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+9:10495:x1874703426804352:12345-192.168.202.6@tcp:36:chown.0 Request processed in 7605us (7818us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787856772.836680:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00010000:00010000:3.0:1787856772.837758:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.837791:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.837797:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.837814:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856772.837819:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.837826:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.837841:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9064c7956d00) 00010000:00010000:3.0:1787856772.837844:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787856772.837848:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.837854:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845356:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845375:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845384:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845390:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856772.845395:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845404:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845426:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9064c7956400) 00010000:00010000:1.0:1787856772.845430:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856772.845436:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845454:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3bc3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845490:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845510:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845516:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845522:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856772.845525:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845531:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845539:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9064c7956d00) 00010000:00010000:1.0:1787856772.845542:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856772.845545:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845551:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3bca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845568:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845575:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845581:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845586:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076ac00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856772.845595:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845601:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845609:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6d00) 00010000:00010000:1.0:1787856772.845612:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787856772.845615:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856772.845621:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ac00/0xc25410d92a3c3bdf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856772.875986:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856772.876092:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426804480 00000100:00100000:0.0:1787856772.876105:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426804480 00000100:00100000:0.0:1787856772.876168:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:0.0:1787856772.876178:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:10496:x1874703426804480:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:0.0:1787856772.876403:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856772.876427:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ed9 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787856772.880804:0:9124:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4130us 00010000:00010000:3.0:1787856772.903701:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.903726:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.903738:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.903754:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.903768:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.903774:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.903908:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3c2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.903917:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.903924:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856772.903956:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787856772.903961:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787856772.904007:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904021:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904027:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904033:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904038:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9e00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856772.904042:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904062:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904078:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6d00) 00010000:00010000:3.0:1787856772.904082:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856772.904087:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904093:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904109:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904115:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904125:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904130:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8e00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856772.904133:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904142:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904149:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9065d3599700) 00010000:00010000:3.0:1787856772.904152:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856772.904158:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904176:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904256:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c3c17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ed9 expref: 8 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904272:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3c2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ed9 expref: 7 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.904280:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9065d3599c00) 00010000:00010000:3.0:1787856772.904282:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787856772.904285:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9000, rc 0) 00000100:00100000:3.0:1787856772.904365:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+7:10496:x1874703426804480:12345-192.168.202.6@tcp:101:touch.500 Request processed in 28188us (28389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856772.904374:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:2.0:1787856772.909628:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856772.909706:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426804736 00000100:00100000:0.0:1787856772.909717:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426804736 00000100:00100000:0.0:1787856772.909783:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:0.0:1787856772.909793:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:10496:x1874703426804736:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:0.0:1787856772.909831:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856772.909851:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3c33 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ee0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.909956:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.909971:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.909982:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.909996:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.910003:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.910009:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787856772.910852:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787856772.911009:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3c48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911021:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3c48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911030:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3c48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911075:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911082:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911089:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911096:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856772.911099:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911106:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911119:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9065d3599c00) 00010000:00010000:0.0:1787856772.911122:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856772.911126:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911132:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c3c3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856772.911146:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076e8eac3 reply state 000000001343a034 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911156:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911162:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9064c7956200) 00010000:00010000:0.0:1787856772.911172:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856772.911175:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787856772.911205:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3c33 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ee0 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911733:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3c48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ee0 expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.911743:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956600) 00010000:00010000:0.0:1787856772.911746:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856772.911749:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c0030200, rc 0) 00000100:00100000:0.0:1787856772.911871:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+10:10496:x1874703426804736:12345-192.168.202.6@tcp:101:touch.500 Request processed in 2079us (2253us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787856772.911879:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1787856772.935917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856772.936624:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426804992 00000100:00100000:0.0:1787856772.936635:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426804992 00000100:00100000:0.0:1787856772.936750:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1787856772.936761:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+10:10496:x1874703426804992:12345-192.168.202.6@tcp:36:touch.500 00010000:00010000:0.0:1787856772.936822:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856772.936849:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3c48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ee0 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.936870:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956600) 00010000:00010000:0.0:1787856772.936882:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856772.936934:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.936949:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.936974:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856772.937084:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fad99dcd reply state 0000000081e2fc5a transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.937096:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856772.937103:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956000) 00010000:00010000:0.0:1787856772.937106:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856772.937109:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856772.937209:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+11:10496:x1874703426804992:12345-192.168.202.6@tcp:36:touch.500 Request processed in 448us (1301us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787856772.937286:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:1.0:1787856772.947416:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856772.947568:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426805120 00000100:00100000:3.0:1787856772.947578:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426805120 00000100:00100000:3.0:1787856772.947645:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:3.0:1787856772.947656:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+11:10496:x1874703426805120:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:3.0:1787856772.947679:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856772.947699:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ee7 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.947760:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ee7 expref: 12 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.947796:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ee7 expref: 12 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856772.947818:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956000) 00010000:00010000:3.0:1787856772.947821:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787856772.947825:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8e00, rc 0) 00000100:00100000:3.0:1787856772.947885:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+12:10496:x1874703426805120:12345-192.168.202.6@tcp:101:touch.500 Request processed in 230us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856772.947892:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:2.0:1787856772.958483:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856772.958627:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426805248 00000100:00100000:0.0:1787856772.958639:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426805248 00000100:00100000:0.0:1787856772.958695:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1787856772.958704:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874703426805248:12345-192.168.202.6@tcp:8:touch.500 00010000:00080000:0.0:1787856772.958744:0:8410:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:0.0:1787856772.958777:0:8410:0:(genops.c:1385:class_connect()) connect: client 898e91b3-529b-44bc-a821-726bff6c71d4, cookie 0xc25410d92a3c3c64 00002000:00100000:0.0:1787856772.958790:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 898e91b3-529b-44bc-a821-726bff6c71d4/ffff9064c802d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787856772.958808:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:0.0:1787856772.958888:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787856772.958919:0:8410:0:(import.c:65:import_set_state_nolock()) ffff9064c8089000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856772.958988:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2398:x1874703426805248:12345-192.168.202.6@tcp:8:touch.500 Request processed in 282us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856772.959012:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1787856772.967833:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856772.967946:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426805376 00000100:00100000:2.0:1787856772.967956:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426805376 00000100:00100000:2.0:1787856772.968051:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:2.0:1787856772.968062:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:0:x1874703426805376:12345-192.168.202.6@tcp:2:touch.500 00000100:00080000:0.0:1787856772.968411:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787856772.982413:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1787856772.982429:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000100:00100000:0.0:1787856772.982664:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:0:x1874703426805376:12345-192.168.202.6@tcp:2:touch.500 Request processed in 14595us (14832us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787856772.982676:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1787856772.985515:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856772.985697:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426805632 00000100:00100000:0.0:1787856772.985707:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426805632 00000100:00100000:0.0:1787856772.985771:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:0.0:1787856772.985781:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+12:10496:x1874703426805632:12345-192.168.202.6@tcp:35:touch.500 00000100:00100000:0.0:1787856772.986085:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+13:10496:x1874703426805632:12345-192.168.202.6@tcp:35:touch.500 Request processed in 304us (577us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787856772.986093:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1787856773.010816:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:1.0:1787856773.010889:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856773.011279:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426805760 00000100:00100000:0.0:1787856773.011298:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426805760 00000100:00100000:0.0:1787856773.011370:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1787856773.011381:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+13:10497:x1874703426805760:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:0.0:1787856773.011404:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856773.011423:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3c6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5eee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.011501:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031c00/0xc25410d92a3c3c72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.011516:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031c00/0xc25410d92a3c3c72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.011527:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031c00/0xc25410d92a3c3c72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856773.011583:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787856773.011586:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856773.011621:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031c00/0xc25410d92a3c3c72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.011657:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3c6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eee expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.011676:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031c00/0xc25410d92a3c3c72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eee expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.011685:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9065d3599c00) 00010000:00010000:0.0:1787856773.011688:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787856773.011691:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c0031c00, rc 0) 00000100:00100000:0.0:1787856773.011746:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+14:10497:x1874703426805760:12345-192.168.202.6@tcp:101:rm.0 Request processed in 367us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856773.011754:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00080000:1.0:1787856773.012033:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856773.015934:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856773.016034:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426806016 00000100:00100000:0.0:1787856773.016048:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426806016 00000100:00100000:0.0:1787856773.016115:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:0.0:1787856773.016125:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+14:10497:x1874703426806016:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:0.0:1787856773.016146:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856773.016166:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3c79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ef5 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856773.016324:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787856773.016586:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3c79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ef5 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.016609:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6d00) 00010000:00010000:0.0:1787856773.016611:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787856773.016618:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3c79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ef5 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.016633:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c0031400, rc 0) 00000100:00100000:0.0:1787856773.016700:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+15:10497:x1874703426806016:12345-192.168.202.6@tcp:101:rm.0 Request processed in 575us (776us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1787856773.016706:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1787856773.040800:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856773.041456:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426806144 00000100:00100000:0.0:1787856773.041468:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426806144 00000100:00100000:0.0:1787856773.041535:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:0.0:1787856773.041546:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+15:10497:x1874703426806144:12345-192.168.202.6@tcp:37:rm.0 00000100:00100000:0.0:1787856773.045984:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+15:10497:x1874703426806144:12345-192.168.202.6@tcp:37:rm.0 Request processed in 4428us (5182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856773.045998:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:3.0:1787856773.054708:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856773.054930:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426806400 00000100:00100000:2.0:1787856773.054940:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426806400 00000100:00100000:2.0:1787856773.055001:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1787856773.055011:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0395450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+15:10497:x1874703426806400:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:2.0:1787856773.055298:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0395450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+16:10497:x1874703426806400:12345-192.168.202.6@tcp:35:rm.0 Request processed in 279us (592us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787856773.055307:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1787856773.061994:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856773.066798:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426806656 00000100:00100000:2.0:1787856773.066812:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426806656 00000100:00100000:2.0:1787856773.066886:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:2.0:1787856773.066894:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8283c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+16:10497:x1874703426806656:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:2.0:1787856773.066915:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856773.066931:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3c87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5efc expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.067019:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ae00/0xc25410d92a3c3c8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.067031:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ae00/0xc25410d92a3c3c8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.067039:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ae00/0xc25410d92a3c3c8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856773.067062:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787856773.067822:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3c87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5efc expref: 19 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.067839:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ae00/0xc25410d92a3c3c8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5efc expref: 18 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.067846:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9065d3599c00) 00010000:00010000:2.0:1787856773.067848:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787856773.067850:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076ae00, rc 0) 00000100:00100000:2.0:1787856773.069932:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8283c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+18:10497:x1874703426806656:12345-192.168.202.6@tcp:101:rm.0 Request processed in 3029us (7937us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787856773.069944:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:2.0:1787856773.081556:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856773.081717:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426806784 00000100:00100000:1.0:1787856773.081728:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426806784 00000100:00100000:1.0:1787856773.081780:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:1.0:1787856773.081791:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+18:10497:x1874703426806784:12345-192.168.202.6@tcp:41:rm.0 00000004:00000024:1.0:1787856773.081846:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1787856773.081929:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+18:10497:x1874703426806784:12345-192.168.202.6@tcp:41:rm.0 Request processed in 139us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856773.081954:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:3.0:1787856773.087604:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856773.089924:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426806912 00000100:00100000:1.0:1787856773.089941:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426806912 00000100:00100000:1.0:1787856773.090024:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:1.0:1787856773.090036:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+18:10497:x1874703426806912:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1787856773.090058:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856773.090079:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c3c9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f03 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090150:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090167:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090179:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090192:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090201:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090207:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090356:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3cb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090384:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090392:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856773.090430:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787856773.090434:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856773.090463:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090475:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090484:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090490:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090497:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090502:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856773.090514:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090522:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090533:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9065d3599c00) 00010000:00010000:1.0:1787856773.090537:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856773.090547:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090554:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3ca3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090566:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090572:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090578:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090583:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856773.090586:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090592:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090598:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9064c7956200) 00010000:00010000:1.0:1787856773.090600:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856773.090603:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090609:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3caa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090630:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c3c9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f03 expref: 20 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090652:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f03 expref: 19 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.090659:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956000) 00010000:00010000:1.0:1787856773.090661:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856773.090663:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939400, rc 0) 00000100:00100000:1.0:1787856773.090735:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+19:10497:x1874703426806912:12345-192.168.202.6@tcp:101:rm.0 Request processed in 702us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856773.090742:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:2.0:1787856773.107340:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856773.107542:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426807168 00000100:00100000:0.0:1787856773.107553:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426807168 00000100:00100000:0.0:1787856773.107619:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:0.0:1787856773.107630:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+19:10497:x1874703426807168:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:0.0:1787856773.107689:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787856773.107717:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3cb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f03 expref: 19 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.107741:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3c5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ee7 expref: 18 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.107770:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956000) 00010000:00010000:0.0:1787856773.107783:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031c00/0xc25410d92a3c3c72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eee expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.107793:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9065d3599c00) 00010000:00010000:0.0:1787856773.107796:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856773.107817:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.107830:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.107840:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.107851:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.107859:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.107866:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108027:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108036:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108054:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787856773.108347:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787856773.108358:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306818140336ns, next at 307818137261ns, rc = 0 00010000:00010000:0.0:1787856773.108410:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108419:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108425:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108431:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108437:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108443:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108469:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856773.108487:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108493:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108498:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108511:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856773.108515:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108523:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108532:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956000) 00010000:00010000:0.0:1787856773.108535:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787856773.108539:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108545:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3cc6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.108560:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856773.108560:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108566:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.108567:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108572:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.108574:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856773.108576:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c0031400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856773.108577:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108579:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.108584:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108585:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.108593:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956000) 00010000:00010000:1.0:1787856773.108595:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787856773.108598:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108601:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9065d3599c00) 00010000:00010000:1.0:1787856773.108604:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c3ccd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108604:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856773.108607:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108612:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031400/0xc25410d92a3c3cb8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856773.108613:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856773.108619:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856773.108621:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1787856773.108621:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e6c02d8 reply state 00000000d18d07ea transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108632:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856773.108638:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9064c7956200) 00010000:00010000:0.0:1787856773.108640:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856773.108642:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856773.108727:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:10497:x1874703426807168:12345-192.168.202.6@tcp:36:rm.0 Request processed in 1098us (1398us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787856773.108735:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:2.0:1787856773.115433:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856773.115741:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426807424 00000100:00100000:0.0:1787856773.115752:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426807424 00000100:00100000:0.0:1787856773.115837:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:0.0:1787856773.115847:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+18:10497:x1874703426807424:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:0.0:1787856773.116089:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+19:10497:x1874703426807424:12345-192.168.202.6@tcp:35:rm.0 Request processed in 243us (666us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787856773.116097:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1787856773.128096:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856773.128333:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426807680 00000100:00100000:2.0:1787856773.128589:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426807680 00000100:00100000:2.0:1787856773.128690:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:2.0:1787856773.128703:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+19:10497:x1874703426807680:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:2.0:1787856773.128963:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787856773.129067:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ae00/0xc25410d92a3c3c8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5efc expref: 19 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.129101:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3c2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ed9 expref: 18 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.129142:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9065d3599c00) 00010000:00010000:2.0:1787856773.129165:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3bed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ecb expref: 17 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.129176:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6d00) 00010000:00010000:2.0:1787856773.129185:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856773.129307:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.129324:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.129336:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.129744:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.129882:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.129891:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.130175:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.130185:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.130210:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856773.132774:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787856773.132886:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.132899:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.132909:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.132916:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856773.132923:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133136:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133158:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9064c73f6f00) 00010000:00010000:2.0:1787856773.133161:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787856773.133167:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133174:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a600/0xc25410d92a3c3ce2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133206:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133212:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133263:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133268:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856773.133282:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133303:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133617:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c73f6100) 00010000:00010000:2.0:1787856773.133620:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856773.133624:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133630:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3cd4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856773.133647:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5f19c7a reply state 0000000039f10dc5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133663:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856773.133672:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9064c73f6700) 00010000:00010000:2.0:1787856773.133674:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787856773.133678:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856773.133889:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+18:10497:x1874703426807680:12345-192.168.202.6@tcp:36:rm.0 Request processed in 5181us (5804us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787856773.133899:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:0.0:1787856773.457606:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436327296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856773.457749:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856773.460563:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436327424:0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.460650:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856773.460680:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436327936:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.461990:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436327680:0@lo:400:kworker.0 00000100:00100000:3.0:1787856773.462083:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436327296 00000100:00100000:3.0:1787856773.462093:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436327296 00000100:00100000:3.0:1787856773.462173:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787856773.462186:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436327296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856773.462233:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856773.463113:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436327808:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.463506:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856773.463566:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436328192:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.463597:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856773.463622:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436328704:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.463648:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856773.463678:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787856773.463686:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436327552:0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.463907:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856773.463937:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436328448:0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.463968:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856773.463997:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436328960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856773.464023:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856773.464074:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436327424 00000100:00100000:2.0:1787856773.464081:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436327424 00000100:00100000:2.0:1787856773.464134:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787856773.464145:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436327424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.464199:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436327424:12345-0@lo:400:kworker.0 Request processed in 56us (3549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856773.464207:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787856773.464266:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436327680 00000100:00100000:2.0:1787856773.464270:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436327680 00000100:00100000:2.0:1787856773.464298:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436327936 00000100:00100000:2.0:1787856773.464301:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436327936 00000100:00100000:2.0:1787856773.464317:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787856773.464324:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436327680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.464362:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436327680:12345-0@lo:400:kworker.0 Request processed in 39us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856773.464369:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787856773.464382:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787856773.464388:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436327936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.464438:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436327936:12345-0@lo:400:kworker.0 Request processed in 51us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856773.464446:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787856773.464466:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436328192 00000100:00100000:2.0:1787856773.464470:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436328192 00000100:00100000:2.0:1787856773.464502:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436328704 00000100:00100000:2.0:1787856773.464505:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436328704 00000100:00100000:2.0:1787856773.464526:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787856773.464533:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436328192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.464567:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436328192:12345-0@lo:400:kworker.0 Request processed in 35us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856773.464574:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787856773.464585:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787856773.464592:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436328704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.464618:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436328704:12345-0@lo:400:kworker.0 Request processed in 27us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856773.464623:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787856773.464661:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436327424:0@lo:400:kworker.0 00000100:00100000:2.0:1787856773.464677:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436327936:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.473196:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856773.473307:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436328064:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.473347:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856773.473376:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436328576:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.473399:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856773.473419:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436329088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856773.473448:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856773.473493:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436327680:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.473512:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436328192:0@lo:400:kworker.0 00010000:00080000:1.0:1787856773.473530:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a3c3c0 x1874703436328704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856773.473542:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436328704:0@lo:400:kworker.0 00000100:00080000:1.0:1787856773.473686:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856773.473717:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856773.473721:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856773.474053:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436327296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11868us (16301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856773.474066:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787856773.474101:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436329088 00000100:00100000:3.0:1787856773.474108:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436329088 00000100:00100000:3.0:1787856773.474161:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787856773.474170:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601998f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436329088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787856773.474202:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856773.474270:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601998f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436329088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856773.474276:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1787856773.474306:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787856773.474329:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7063840 x1874703436329088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856773.474347:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436329088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856773.474500:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436327552 00000100:00100000:3.0:1787856773.474505:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436327552 00000100:00100000:3.0:1787856773.474528:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436328576 00000100:00100000:3.0:1787856773.474531:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436328576 00000100:00100000:3.0:1787856773.474552:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787856773.474558:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436327552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856773.474597:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436327552:12345-0@lo:400:kworker.0 Request processed in 40us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856773.474603:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787856773.474614:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787856773.474619:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436328576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856773.474640:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436328576:12345-0@lo:400:kworker.0 Request processed in 22us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856773.474645:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1787856773.474656:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856773.474672:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436327552:0@lo:400:kworker.0 00000100:00100000:3.0:1787856773.474682:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436328576:0@lo:400:kworker.0 00000100:00100000:3.0:1787856773.474741:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436328448 00000100:00100000:3.0:1787856773.474745:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436328448 00000100:00100000:3.0:1787856773.474796:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436328064 00000100:00100000:3.0:1787856773.474799:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436328064 00000100:00100000:3.0:1787856773.474814:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787856773.474820:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436328448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856773.474853:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436328448:12345-0@lo:400:kworker.0 Request processed in 34us (10885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856773.474858:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787856773.474868:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787856773.474874:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601998780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436328064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856773.474900:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601998780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436328064:12345-0@lo:400:kworker.0 Request processed in 27us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856773.474906:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787856773.474922:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787856773.474950:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90660193ed00 x1874703436328064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856773.474959:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436328064:0@lo:400:kworker.0 00000100:00100000:0.0:1787856773.476542:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856773.476597:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436328320:0@lo:400:kworker.0 00000100:00100000:0.0:1787856773.476628:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856773.476671:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436327808 00000100:00100000:0.0:1787856773.476677:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436327808 00000100:00100000:0.0:1787856773.476737:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436328320 00000100:00100000:0.0:1787856773.476740:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436328320 00000100:00100000:0.0:1787856773.476967:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787856773.476976:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436327808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856773.477026:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436327808:12345-0@lo:400:kworker.0 Request processed in 52us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856773.477033:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787856773.477050:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787856773.477055:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7063840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436328320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856773.477078:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7063840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436328320:12345-0@lo:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856773.477084:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1787856773.477103:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787856773.477138:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8246940 x1874703436328320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856773.477154:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436328320:0@lo:400:kworker.0 00000100:00100000:0.0:1787856773.477163:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436328832:0@lo:400:kworker.0 00000100:00100000:0.0:1787856773.477194:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856773.477259:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436328832 00000100:00100000:0.0:1787856773.477263:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436328832 00000100:00100000:0.0:1787856773.477300:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787856773.477307:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436328832:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787856773.477491:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a3cb40 x1874703436328448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856773.477504:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436328448:0@lo:400:kworker.0 00000100:00100000:0.0:1787856773.477810:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436328832:12345-0@lo:400:kworker.0 Request processed in 503us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856773.477818:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1787856773.477843:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a3e580 x1874703436328832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856773.477853:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436328832:0@lo:400:kworker.0 00010000:00080000:0.0:1787856773.477866:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008df840 x1874703436327296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856773.477882:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436327296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856773.477916:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436327808:0@lo:400:kworker.0 00000100:00100000:1.0:1787856773.478029:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436328960 00000100:00100000:1.0:1787856773.478037:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436328960 00000100:00100000:1.0:1787856773.478086:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787856773.478094:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436328960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856773.478121:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856773.478179:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436328960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (14155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856773.478186:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1787856773.479850:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8283480 x1874703436328960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856773.479884:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436328960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856773.972471:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856773.973073:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660199a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436329216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856773.973178:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856773.973506:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436329216 00000100:00100000:2.0:1787856773.973518:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436329216 00000100:00100000:2.0:1787856773.973705:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787856773.973729:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436329216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856773.973779:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856773.973853:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436329216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856773.973861:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1787856773.974028:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90660199a1c0 x1874703436329216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856773.974051:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660199a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436329216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856774.033523:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856774.486954:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856774.486993:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436329344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856774.487096:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856774.487762:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436329344 00000100:00100000:3.0:1787856774.487774:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436329344 00000100:00100000:3.0:1787856774.492748:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787856774.492778:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436329344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856774.492851:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856774.492968:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436329344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856774.492976:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787856774.493921:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436329344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856774.994442:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856774.994477:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436329472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856774.994560:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856775.000599:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436329472 00000100:00100000:2.0:1787856775.000616:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436329472 00000100:00100000:3.0:1787856775.000858:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787856775.000870:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066019992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436329472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856775.000926:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856775.001034:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066019992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436329472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (6472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856775.001041:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787856775.001269:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436329472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787856775.063943:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856776.090889:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856776.669572:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856776.669619:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856776.669656:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856776.669840:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426807936 00000100:00100000:3.0:1787856776.669852:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426807936 00000100:00100000:0.0:1787856776.669871:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426808192 00000100:00100000:0.0:1787856776.669877:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426808192 00000100:00100000:0.0:1787856776.669929:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1787856776.669940:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426808192:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856776.670027:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426808192:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856776.670037:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00080000:0.0:1787856776.670079:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856776.670085:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856776.670272:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856776.670399:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856776.670420:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856776.670609:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426807808 00000100:00100000:0.0:1787856776.670615:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426807808 00000100:00100000:0.0:1787856776.670654:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 339 00000100:00100000:0.0:1787856776.670663:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2402:x1874703426807808:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856776.670714:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2402:x1874703426807808:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 52us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856776.670721:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 339 00000100:00100000:0.0:1787856776.670755:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426808448 00000100:00100000:0.0:1787856776.670758:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426808448 00000100:00100000:0.0:1787856776.670803:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426808064 00000100:00100000:0.0:1787856776.670807:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426808064 00000100:00100000:0.0:1787856776.670820:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426808320 00000100:00100000:0.0:1787856776.670822:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426808320 00000100:00100000:0.0:1787856776.670836:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:0.0:1787856776.670842:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426808448:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856776.670872:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426808448:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856776.670879:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:0.0:1787856776.670892:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:0.0:1787856776.670897:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426808064:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856776.670919:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426808064:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856776.670933:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:0.0:1787856776.670944:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:0.0:1787856776.670949:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426808320:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856776.670974:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426808320:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856776.670980:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00080000:0.0:1787856776.671007:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856776.671011:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856776.673250:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:3.0:1787856776.673284:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+18:2402:x1874703426807936:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856776.673411:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+18:2402:x1874703426807936:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 136us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856776.673421:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 229 00010000:00010000:0.0:1787856777.106205:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787856777.962111:0:13660:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1787856778.070774:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787856778.070797:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787856778.070920:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436329600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787856778.070985:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856778.071082:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436329600 00000100:00100000:0.0:1787856778.071090:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436329600 00000100:00100000:0.0:1787856778.071141:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787856778.071152:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436329600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787856778.071181:0:10490:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1787856778.071317:0:10490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a908784, atime: 0x6a908784, ctime: 0x6a908784, blocks: 0x0 00010000:00010000:0.0:1787856778.071327:0:10490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.071344:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1787856778.071349:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856778.071356:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.071391:0:10490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.071402:0:10490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.071411:0:10490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.071431:0:10490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787856778.071563:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071572:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071578:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071592:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c0031200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856778.071596:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071604:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071621:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9064c7956200) 00010000:00010000:2.0:1787856778.071624:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856778.071629:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071635:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031200/0xc25410d92a3c3c41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071654:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071660:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071665:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071669:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c0031600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856778.071671:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071677:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071694:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9064c7956000) 00010000:00010000:2.0:1787856778.071696:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856778.071699:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071704:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0031600/0xc25410d92a3c3c56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071718:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071724:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071729:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071732:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c0030200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856778.071735:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071739:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071745:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9064c7956200) 00010000:00010000:2.0:1787856778.071747:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856778.071750:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071755:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c3cbf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071783:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071789:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071795:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071801:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856778.071804:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071809:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071817:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9064c73f6700) 00010000:00010000:2.0:1787856778.071820:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856778.071823:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856778.071829:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3cdb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856778.072005:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436329600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 854us (1018us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787856778.072014:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787856778.072041:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787856778.072055:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856778.072061:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.072069:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bae00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856778.072073:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.072080:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.072103:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.072109:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fcf6a47/0xc25410d92a3c3ce9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856778.072122:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856778.072124:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856778.072125:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787856778.072356:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9065fe80de00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787856778.072365:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436329600:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787856778.129665:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856778.577778:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436329728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856778.577858:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856778.577939:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436329728 00000100:00100000:0.0:1787856778.577946:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436329728 00000100:00100000:1.0:1787856778.578079:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660199bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436329856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856778.578109:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856778.578151:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436329856 00000100:00100000:1.0:1787856778.578155:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436329856 00000100:00100000:1.0:1787856778.578210:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787856778.578254:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436329856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856778.578284:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856778.578329:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436329856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856778.578335:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1787856778.578379:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787856778.578410:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90660199bc00 x1874703436329856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856778.578429:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660199bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436329856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856778.578704:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787856778.578713:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436329728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856778.578735:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856778.578776:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436329728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856778.578783:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787856778.578828:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436329728:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787856778.578897:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856778.579381:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436330240:0@lo:400:kworker.0 00000100:00100000:0.0:1787856778.579447:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856778.579472:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436330752:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.579566:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436329984:0@lo:400:kworker.0 00000100:00100000:2.0:1787856778.581539:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436330368:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.585756:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856778.585816:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436330496:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.585865:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856778.585887:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436331008:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.585912:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856778.585967:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436329984 00000100:00100000:1.0:1787856778.585973:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436329984 00000100:00100000:1.0:1787856778.586019:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787856778.586028:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436329984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.586079:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436329984:12345-0@lo:400:kworker.0 Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856778.586086:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787856778.586117:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436330240 00000100:00100000:1.0:1787856778.586121:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436330240 00000100:00100000:1.0:1787856778.586138:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436330496 00000100:00100000:1.0:1787856778.586140:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436330496 00000100:00100000:1.0:1787856778.586717:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787856778.586725:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436330240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.586770:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436330240:12345-0@lo:400:kworker.0 Request processed in 45us (7323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856778.586793:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787856778.586811:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787856778.586816:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436330496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.586845:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436330496:12345-0@lo:400:kworker.0 Request processed in 30us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856778.586851:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787856778.586871:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436331008 00000100:00100000:1.0:1787856778.586875:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436331008 00000100:00100000:1.0:1787856778.586911:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787856778.586918:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436331008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.587011:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436331008:12345-0@lo:400:kworker.0 Request processed in 31us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856778.587019:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787856778.587050:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436330112:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.587078:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856778.587101:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436330624:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.587125:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856778.587864:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436331136:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.587903:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856778.587946:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436330112 00000100:00100000:1.0:1787856778.588294:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436330112 00000100:00100000:1.0:1787856778.588334:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436331136 00000100:00100000:1.0:1787856778.588338:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436331136 00000100:00100000:1.0:1787856778.588360:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787856778.588368:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436330112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.588423:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436330112:12345-0@lo:400:kworker.0 Request processed in 55us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856778.588430:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787856778.588444:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787856778.588450:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601998b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436331136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.588478:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601998b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436331136:12345-0@lo:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856778.588483:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787856778.588503:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436330624 00000100:00100000:1.0:1787856778.588506:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436330624 00000100:00100000:1.0:1787856778.588537:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787856778.588544:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436330624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.588587:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436330624:12345-0@lo:400:kworker.0 Request processed in 43us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856778.588593:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787856778.588620:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856778.588625:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856778.588627:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856778.588657:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436330112:0@lo:400:kworker.0 00010000:00080000:1.0:1787856778.588670:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5f840 x1874703436330624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856778.588679:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436330624:0@lo:400:kworker.0 00010000:00080000:1.0:1787856778.588688:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7a95e00 x1874703436331136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856778.588697:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436331136:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.588746:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436329984:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.588759:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436330496:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.588771:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436331008:0@lo:400:kworker.0 00000100:00100000:1.0:1787856778.588857:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856778.588866:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660199ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436331392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856778.588896:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856778.588926:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436331392 00000100:00100000:1.0:1787856778.588930:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436331392 00000100:00100000:2.0:1787856778.589097:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856778.589122:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436330880:0@lo:400:kworker.0 00000100:00100000:2.0:1787856778.589167:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856778.589199:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436330368 00000100:00100000:2.0:1787856778.589203:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436330368 00000100:00100000:2.0:1787856778.589250:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436330880 00000100:00100000:2.0:1787856778.589254:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436330880 00000100:00100000:2.0:1787856778.589279:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787856778.589285:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436330368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856778.589321:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436330368:12345-0@lo:400:kworker.0 Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856778.589327:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787856778.589340:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787856778.589346:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436330880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856778.589372:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874703436330880:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856778.589377:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:2.0:1787856778.589393:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856778.589412:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436330368:0@lo:400:kworker.0 00010000:00080000:2.0:1787856778.589422:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5c000 x1874703436330880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856778.589431:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436330880:0@lo:400:kworker.0 00000100:00100000:0.0:1787856778.590390:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856778.590439:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436330752 00000100:00100000:0.0:1787856778.590444:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436330752 00000100:00100000:0.0:1787856778.590485:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787856778.590492:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436330752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856778.590531:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436330752:12345-0@lo:400:kworker.0 Request processed in 40us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856778.590538:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:0.0:1787856778.590560:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856778.590579:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787856778.590588:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066019983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436331392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856778.590603:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856778.590642:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066019983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436331392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856778.590648:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787856778.590686:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660199ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436331392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856778.590723:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436330752:0@lo:400:kworker.0 00000100:00100000:0.0:1787856778.590732:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436331264:0@lo:400:kworker.0 00000100:00100000:0.0:1787856778.590757:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856778.590779:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436331264 00000100:00100000:0.0:1787856778.590783:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436331264 00000100:00100000:0.0:1787856778.590805:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787856778.590811:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436331264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856778.590839:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436331264:12345-0@lo:400:kworker.0 Request processed in 28us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856778.590845:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787856778.590869:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436331264:0@lo:400:kworker.0 00000100:00100000:0.0:1787856778.590900:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436330240:0@lo:400:kworker.0 00000100:00100000:3.0:1787856779.090462:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856779.090487:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436331520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856779.090560:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856779.090626:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436331520 00000100:00100000:3.0:1787856779.090634:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436331520 00000100:00100000:3.0:1787856779.090679:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787856779.090688:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436331520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856779.090712:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856779.090758:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436331520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856779.090764:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1787856779.090802:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008df840 x1874703436331520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856779.090820:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436331520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856779.154742:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787856779.374851:0:13708:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce6ff4d80 20000000:00000080:2.0:1787856779.374869:0:13708:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9064c8303000 uarg=0000000000000000 20000000:01000000:2.0:1787856779.374913:0:13708:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787856779.374919:0:13708:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787856779.374924:0:13708:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787856779.375845:0:13709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787856779.376014:0:13708:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787856779.379697:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787856779.379725:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787856779.379734:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787856779.379746:0:13708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787856779.379764:0:13708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379779:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379785:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379789:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379793:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379799:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379803:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379808:0:13708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379839:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.379864:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 12 pid: 6488 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.379876:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008df840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436331648:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856779.380003:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.380009:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 12 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.380014:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7beda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436331776:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856779.380032:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.380037:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 23 pid: 6490 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.380043:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436331904:0@lo:104: 00000100:00100000:3.0:1787856779.380082:0:13708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787856779.380120:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.380128:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 23 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856779.380129:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787856779.380136:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436332032:0@lo:104: 00000100:00100000:1.0:1787856779.380142:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436331904 00000100:00100000:1.0:1787856779.380148:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436331904 00000100:00100000:3.0:1787856779.380155:0:13708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856779.380195:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436332032 00000100:00100000:1.0:1787856779.380198:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436332032 00010000:00010000:3.0:1787856779.380205:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856779.380214:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787856779.380254:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660063bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:13708:x1874703436331904:12345-0@lo:104: 00010000:00010000:3.0:1787856779.380258:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 23 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.380266:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436332160:0@lo:104: 00010000:00010000:1.0:1787856779.380276:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380327:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787856779.380333:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660063bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:13708:x1874703436331904:12345-0@lo:104: Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856779.380340:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787856779.380379:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787856779.380386:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7becf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:13708:x1874703436332032:12345-0@lo:104: 00010000:00010000:1.0:1787856779.380393:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380432:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787856779.380437:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7becf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:13708:x1874703436332032:12345-0@lo:104: Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856779.380443:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1787856779.380459:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856779.380477:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380484:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856779.380488:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380496:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856779.380503:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856779.380509:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787856779.380531:0:13708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856779.380534:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380540:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856779.380553:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380558:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.380561:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 23 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380565:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c3ba0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3ba7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.380569:0:13708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436332416:0@lo:104: 00010000:00010000:1.0:1787856779.380587:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787856779.380588:0:13708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856779.380590:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380596:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fee00 already unused, calling callback (ffffffffc1414c20) 00000100:00100000:3.0:1787856779.380597:0:13708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e300 going to sleep for 11 seconds 10000000:00010000:1.0:1787856779.380599:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380605:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856779.380611:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.380614:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436331904:0@lo:104: 10000000:01000000:1.0:1787856779.380616:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787856779.380621:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436332032:0@lo:104: 00010000:00010000:1.0:1787856779.380628:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380633:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856779.380639:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380645:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fee00/0xc25410d92a3c3b92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b99 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380654:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856779.380655:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856779.380657:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856779.380674:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660199ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436332288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856779.380706:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856779.380741:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856779.380748:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436332544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856779.380768:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856779.380797:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436332160 00000100:00100000:1.0:1787856779.380800:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436332160 00000100:00100000:1.0:1787856779.380813:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436332416 00000100:00100000:1.0:1787856779.380815:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436332416 00000100:00100000:1.0:1787856779.380825:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787856779.380830:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:13708:x1874703436332160:12345-0@lo:104: 00010000:00010000:1.0:1787856779.380836:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380866:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787856779.380871:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+4:13708:x1874703436332160:12345-0@lo:104: Request processed in 41us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856779.380876:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787856779.380887:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787856779.380893:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:13708:x1874703436332416:12345-0@lo:104: 00010000:00010000:1.0:1787856779.380900:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.380937:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787856779.380942:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c911024a-9030-4ea8-a782-9255ee9580a7+3:13708:x1874703436332416:12345-0@lo:104: Request processed in 50us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856779.380948:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1787856779.380979:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787856779.380984:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.380992:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856779.380995:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381002:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856779.381008:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856779.381013:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787856779.381039:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381045:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856779.381061:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381072:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c3b84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b8b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381081:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856779.381084:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381090:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274a400 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856779.381093:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.381097:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436332288 00000100:00100000:3.0:1787856779.381101:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436332288 00010000:00010000:2.0:1787856779.381105:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856779.381111:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856779.381116:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787856779.381118:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 24 pid: 6490 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381128:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381133:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787856779.381135:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436332544 00000100:00100000:3.0:1787856779.381138:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436332544 00010000:00010000:2.0:1787856779.381139:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381145:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274a400/0xc25410d92a3c3b76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c3b7d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.381146:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 25 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381158:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856779.381160:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856779.381162:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1787856779.381162:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856779.381168:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601999680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+25:3625:x1874703436332288:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856779.381171:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436332672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856779.381184:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856779.381189:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 25 pid: 6490 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856779.381197:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787856779.381199:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 25 pid: 6490 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.381211:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274a600/0xc25410d92a3c3ba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3ba0 expref: 25 pid: 6490 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856779.381248:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787856779.381254:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436332800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856779.381255:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856779.381275:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856779.381287:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601999680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436332288:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856779.381294:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787856779.381305:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436332672 00000100:00100000:3.0:1787856779.381308:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436332672 00000100:00100000:2.0:1787856779.381308:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436332800 00000100:00100000:2.0:1787856779.381311:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436332800 00010000:00010000:3.0:1787856779.381319:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 25 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381323:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 25 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.381331:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787856779.381336:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+25:3625:x1874703436332544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856779.381343:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787856779.381346:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1787856779.381347:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 25 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856779.381351:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+25:3623:x1874703436332672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856779.381355:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 25 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381357:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856779.381361:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 25 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.381366:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906601938a00/0xc25410d92a3c3b99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3b92 expref: 25 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.381382:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 24 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.381453:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856779.381490:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+24:3625:x1874703436332544:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856779.381497:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787856779.381509:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787856779.381514:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436332800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856779.381521:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856779.381525:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 23 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.381533:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 23 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.381543:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856779.381571:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436332800:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856779.381577:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787856779.381612:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436332160:0@lo:104: 00010000:00010000:3.0:1787856779.381622:0:13708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ffc00/0xc25410d92a3c3b7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3b76 expref: 22 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.381630:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436332416:0@lo:104: 00000100:00100000:1.0:1787856779.381836:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436332544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856779.381854:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660199ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436332288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856779.381900:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856779.381913:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856779.383713:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076be00/0xc25410d92a3c3b8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c3b84 expref: 21 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.383737:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856779.383806:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c911024a-9030-4ea8-a782-9255ee9580a7+20:3623:x1874703436332672:12345-0@lo:103:ldlm_bl.0 Request processed in 2453us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856779.383815:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787856779.383872:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436332800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856779.383882:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436332672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856779.389824:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008df840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436331648:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856779.389839:0:13708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7beda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1874703436331776:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856779.389882:0:13708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856779.390814:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856779.390900:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856779.390985:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426808704 00000100:00100000:0.0:1787856779.390993:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426808704 00010000:00010000:0.0:1787856779.391030:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 13 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856779.391328:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426808576 00000100:00100000:0.0:1787856779.391333:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426808576 00010000:00010000:0.0:1787856779.391348:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 14 pid: 6488 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856779.392881:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:1.0:1787856779.392902:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f992ea53-5038-46c1-bdd9-a3b884b74351+14:2402:x1874703426808704:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856779.392923:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856779.392931:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 14 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.392934:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:3.0:1787856779.392944:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f992ea53-5038-46c1-bdd9-a3b884b74351+14:2402:x1874703426808576:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856779.392946:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 14 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.392951:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856779.392955:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 14 pid: 6488 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.392967:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274ba00/0xc25410d92a3c3bae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5eb6 expref: 14 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.392969:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 14 pid: 6488 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.392979:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076b400/0xc25410d92a3c3bb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ebd expref: 13 pid: 6488 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.392985:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.392994:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856779.393156:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856779.393245:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f992ea53-5038-46c1-bdd9-a3b884b74351+12:2402:x1874703426808576:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 272us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856779.393254:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00010000:00010000:1.0:1787856779.393558:0:8425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.393568:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.393584:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.393592:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.393614:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9e00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856779.393618:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.393625:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.393646:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856779.393657:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856779.393680:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f992ea53-5038-46c1-bdd9-a3b884b74351+11:2402:x1874703426808704:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 787us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856779.393687:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00010000:00010000:2.0:1787856779.394952:0:13708:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.394969:0:13708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856779.394975:0:13708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c3cf0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856779.601418:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856779.601442:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436332928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856779.601651:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856779.601756:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436332928 00000100:00100000:2.0:1787856779.601765:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436332928 00000100:00100000:2.0:1787856779.601818:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787856779.601829:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436332928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787856779.601863:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787856779.601918:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436332928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856779.601925:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787856779.602021:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436332928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856780.125509:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436333056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856780.127604:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856780.127746:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436333056 00000100:00100000:2.0:1787856780.127755:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436333056 00000100:00100000:2.0:1787856780.127826:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787856780.127838:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436333056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856780.127876:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787856780.127991:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436333056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856780.127999:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787856780.128661:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436333056:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787856780.180057:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787856780.360106:0:13758:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff40634830 20000000:00000080:3.0:1787856780.360124:0:13758:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9064c82f3800 uarg=0000000000000000 20000000:01000000:3.0:1787856780.360174:0:13758:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787856780.360180:0:13758:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787856780.360191:0:13758:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1787856780.362860:0:13759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1787856780.364648:0:13758:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787856780.364757:0:13758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787856780.364788:0:13758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787856780.364802:0:13758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787856780.364812:0:13758:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787856780.364834:0:13758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364850:0:13758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364860:0:13758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364866:0:13758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364873:0:13758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364879:0:13758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364885:0:13758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8c00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856780.364888:0:13758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364895:0:13758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364908:0:13758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364930:0:13758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856780.364936:0:13758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c8c00/0xc25410d92a3c3cf7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856781.074270:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856781.074280:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe85b800 from 7 10000000:01000000:1.0:1787856781.074285:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856781.074335:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.074347:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.074357:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856781.074384:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660199ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856781.074453:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856781.074518:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9c113c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.074737:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436333184 00000100:00100000:2.0:1787856781.074744:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436333184 00000100:00100000:2.0:1787856781.074799:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787856781.074808:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+20:6493:x1874703436333184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856781.074821:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856781.074835:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076ac00/0xc25410d92a3c3d05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3cfe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.074864:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076ac00/0xc25410d92a3c3d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3cfe expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.074874:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076ac00/0xc25410d92a3c3d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3cfe expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.074883:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076ac00, rc 0) 00000100:00100000:2.0:1787856781.074935:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436333184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.074942:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787856781.075074:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660199ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856781.075088:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856781.075097:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856781.075165:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856781.075194:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856781.075269:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787856781.075347:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436333312 00000100:00100000:1.0:1787856781.075352:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436333312 00000100:00100000:1.0:1787856781.075383:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787856781.075390:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436333312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856781.075504:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436333312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856781.075511:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787856781.075583:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856781.075614:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856781.075650:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856781.075671:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856781.075730:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436333440 00000100:00100000:0.0:1787856781.075734:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436333440 00000100:00100000:0.0:1787856781.075755:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787856781.075762:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436333440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856781.075849:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436333440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856781.075856:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787856781.075934:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856781.076332:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13771:1874703436333568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856781.076369:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856781.076398:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9c11600 going to sleep for 11 seconds 00000100:00100000:0.0:1787856781.076448:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436333568 00000100:00100000:0.0:1787856781.076453:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436333568 00000100:00100000:0.0:1787856781.076482:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787856781.076489:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:13771:x1874703436333568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856781.076565:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:13771:x1874703436333568:12345-0@lo:502:llog_process_th.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856781.076582:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787856781.076657:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13771:1874703436333568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787856781.076687:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856781.076696:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856781.076704:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787856781.076711:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065fe85b800 00000020:00000080:3.0:1787856781.076714:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787856781.076775:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856781.076779:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856781.076781:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787856781.076784:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856781.076787:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856781.076788:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787856781.076791:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065fe85b800 00000020:00000080:3.0:1787856781.076793:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787856781.076826:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13771:1874703436333696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856781.076856:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856781.076869:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787856781.076919:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436333696 00000100:00100000:1.0:1787856781.076923:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436333696 00000100:00100000:1.0:1787856781.076941:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787856781.076946:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:13771:x1874703436333696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856781.077022:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+21:13771:x1874703436333696:12345-0@lo:502:llog_process_th.0 Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856781.077028:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787856781.077104:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13771:1874703436333696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787856781.077122:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856781.077126:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856781.077127:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787856781.077131:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787856781.077318:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787856781.077339:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856781.077348:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.077357:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856781.077366:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856781.077369:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe6d5000 from 7 10000000:01000000:1.0:1787856781.077372:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856781.077400:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.077407:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.077415:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856781.077427:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856781.077454:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856781.077483:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9c11180 going to sleep for 11 seconds 00000100:00100000:0.0:1787856781.079713:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436333824 00000100:00100000:0.0:1787856781.079725:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436333824 00000100:00100000:0.0:1787856781.079765:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787856781.079775:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+21:6493:x1874703436333824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856781.079788:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856781.079804:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007ba600/0xc25410d92a3c3d13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3d0c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856781.079827:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007ba600/0xc25410d92a3c3d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3d0c expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856781.079838:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007ba600/0xc25410d92a3c3d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3d0c expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856781.079846:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba600, rc 0) 00000100:00100000:0.0:1787856781.079910:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436333824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856781.079917:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787856781.083294:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856781.083324:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.083336:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856781.083429:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856781.083491:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856781.083535:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9c11180 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.083727:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436333952 00000100:00100000:2.0:1787856781.083733:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436333952 00000100:00100000:2.0:1787856781.083776:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787856781.083785:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436333952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.083902:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436333952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.083910:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787856781.084679:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436333952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856781.084731:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436334080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856781.084778:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856781.084801:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9c11180 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.084848:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436334080 00000100:00100000:2.0:1787856781.084852:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436334080 00000100:00100000:2.0:1787856781.084885:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787856781.084892:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436334080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.084975:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436334080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.084982:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787856781.085180:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436334080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856781.086533:0:13773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13773:1874703436334208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856781.086600:0:13773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856781.086648:0:13773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856781.086706:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436334208 00000100:00100000:1.0:1787856781.086712:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436334208 00000100:00100000:1.0:1787856781.086745:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787856781.086753:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:13773:x1874703436334208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856781.086860:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+22:13773:x1874703436334208:12345-0@lo:502:llog_process_th.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856781.086867:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787856781.087045:0:13773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13773:1874703436334208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787856781.087071:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856781.087082:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856781.087085:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787856781.087093:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065fe6d5000 00000020:00000080:3.0:1787856781.087095:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787856781.087161:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856781.087180:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856781.087182:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787856781.087186:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856781.087188:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856781.087190:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787856781.087194:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065fe6d5000 00000020:00000080:3.0:1787856781.087196:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787856781.087268:0:13773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13773:1874703436334336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856781.087303:0:13773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856781.087326:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436334336 00000100:00100000:3.0:1787856781.087330:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436334336 00000100:00100000:3.0:1787856781.087355:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787856781.087362:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:13773:x1874703436334336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856781.087425:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+22:13773:x1874703436334336:12345-0@lo:502:llog_process_th.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856781.087432:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787856781.087596:0:13773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b8ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787856781.087610:0:13773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7b2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13773:1874703436334336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787856781.087627:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856781.087631:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856781.087633:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787856781.087636:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787856781.088557:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787856781.088583:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856781.088593:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.088606:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856781.088618:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856781.088620:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065f7199800 from 7 10000000:01000000:1.0:1787856781.088623:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856781.088649:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.088657:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856781.088667:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856781.088683:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436334464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856781.089104:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856781.089140:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9c11180 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.089531:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436334464 00000100:00100000:2.0:1787856781.089538:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436334464 00000100:00100000:2.0:1787856781.089586:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787856781.089596:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+22:6493:x1874703436334464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856781.089610:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856781.089624:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3d21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3d1a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.089648:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3d1a expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.089659:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3d1a expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.089668:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076ba00, rc 0) 00000100:00100000:2.0:1787856781.090157:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436334464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 561us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.090177:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787856781.090278:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436334464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856781.090292:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.090302:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856781.090383:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436334592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.090412:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.090439:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.090479:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436334592 00000100:00100000:2.0:1787856781.090483:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436334592 00000100:00100000:2.0:1787856781.090515:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787856781.090521:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436334592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.090621:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436334592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.090628:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787856781.090657:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436334592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.090700:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436334720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.090739:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.090753:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.090764:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436334720 00000100:00100000:2.0:1787856781.090767:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436334720 00000100:00100000:2.0:1787856781.090785:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787856781.090791:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436334720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.090860:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436334720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.090867:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787856781.090902:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436334720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.091075:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13774:1874703436334848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856781.091110:0:13774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.091127:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436334848 00000100:00100000:2.0:1787856781.091130:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436334848 00000100:00100000:2.0:1787856781.091150:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787856781.091157:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:13774:x1874703436334848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856781.091258:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:13774:x1874703436334848:12345-0@lo:502:llog_process_th.0 Request processed in 101us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.091270:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787856781.091296:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37780 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.091308:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13774:1874703436334848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856781.091327:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856781.091335:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856781.091338:0:13774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787856781.091348:0:13774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065f7199800 00000020:00000080:2.0:1787856781.091350:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787856781.091406:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856781.091409:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856781.091411:0:13774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787856781.091414:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856781.091417:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856781.091418:0:13774:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787856781.091422:0:13774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065f7199800 00000020:00000080:2.0:1787856781.091424:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787856781.091454:0:13774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13774:1874703436334976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856781.091485:0:13774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.091504:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436334976 00000100:00100000:2.0:1787856781.091508:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436334976 00000100:00100000:2.0:1787856781.091528:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787856781.091534:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:13774:x1874703436334976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856781.091586:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:13774:x1874703436334976:12345-0@lo:502:llog_process_th.0 Request processed in 51us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.091592:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787856781.091618:0:13774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.091628:0:13774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13774:1874703436334976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856781.091648:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856781.091652:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856781.091653:0:13774:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787856781.091657:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787856781.091703:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787856781.091725:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787856781.091733:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.091742:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856781.091753:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787856781.091755:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065d3be8000 from 7 10000000:01000000:2.0:1787856781.091757:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787856781.091776:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.091783:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.091790:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856781.091801:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436335104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.091824:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.091836:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.091846:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436335104 00000100:00100000:2.0:1787856781.091850:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436335104 00000100:00100000:2.0:1787856781.091870:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787856781.091883:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+23:6493:x1874703436335104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856781.091890:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856781.091901:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3d2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c3d28 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.091917:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c3d28 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.091927:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c3d28 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.091935:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076ae00, rc 0) 00000100:00100000:2.0:1787856781.091963:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436335104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.091968:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787856781.091995:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436335104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856781.092006:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.092014:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856781.092053:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436335232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.092075:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.092087:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.092097:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436335232 00000100:00100000:2.0:1787856781.092100:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436335232 00000100:00100000:2.0:1787856781.092120:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787856781.092132:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436335232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.092203:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436335232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.092210:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787856781.092273:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436335232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.092296:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436335360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.092328:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.092341:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.092351:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436335360 00000100:00100000:2.0:1787856781.092355:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436335360 00000100:00100000:2.0:1787856781.092376:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787856781.092382:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436335360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.092440:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:6493:x1874703436335360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.092446:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787856781.092480:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c911024a-9030-4ea8-a782-9255ee9580a7:6493:1874703436335360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.092708:0:13775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13775:1874703436335488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856781.092740:0:13775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.092758:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436335488 00000100:00100000:2.0:1787856781.092762:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436335488 00000100:00100000:2.0:1787856781.092783:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787856781.092788:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:13775:x1874703436335488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856781.092844:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:13775:x1874703436335488:12345-0@lo:502:llog_process_th.0 Request processed in 55us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.092859:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787856781.092884:0:13775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.092895:0:13775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13775:1874703436335488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856781.092914:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856781.092921:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856781.092923:0:13775:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787856781.092931:0:13775:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065d3be8000 00000020:00000080:2.0:1787856781.092933:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787856781.092965:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856781.092969:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856781.092970:0:13775:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787856781.092972:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856781.092974:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856781.092975:0:13775:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787856781.092979:0:13775:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065d3be8000 00000020:00000080:2.0:1787856781.092980:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787856781.093009:0:13775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13775:1874703436335616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856781.093041:0:13775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856781.093061:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436335616 00000100:00100000:2.0:1787856781.093065:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436335616 00000100:00100000:2.0:1787856781.093086:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787856781.093092:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:13775:x1874703436335616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856781.093147:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:13775:x1874703436335616:12345-0@lo:502:llog_process_th.0 Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.093154:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787856781.093180:0:13775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787856781.093191:0:13775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c911024a-9030-4ea8-a782-9255ee9580a7:13775:1874703436335616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856781.095977:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856781.095991:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856781.095994:0:13775:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787856781.096004:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787856781.099328:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787856781.099382:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787856781.099394:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856781.099408:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856781.106089:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787856781.125007:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787856781.202322:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856781.345459:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856781.345590:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426808832 00000100:00100000:2.0:1787856781.345600:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426808832 00000100:00100000:2.0:1787856781.345659:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 361 00000100:00100000:2.0:1787856781.345667:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+11:6174:x1874703426808832:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856781.345684:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856781.345699:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660076a600/0xc25410d92a3c3d36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f0a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.345726:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660076a600/0xc25410d92a3c3d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f0a expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.345737:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660076a600/0xc25410d92a3c3d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f0a expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856781.345747:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a600, rc 0) 00000100:00100000:2.0:1787856781.345802:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426808832:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 135us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.345809:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 361 00000100:00100000:0.0:1787856781.348677:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856781.348765:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426808960 00000100:00100000:3.0:1787856781.348774:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426808960 00000100:00100000:3.0:1787856781.348830:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 362 00000100:00100000:3.0:1787856781.348841:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426808960:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856781.348984:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426808960:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 145us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856781.349005:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 362 00000100:00100000:3.0:1787856781.352857:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856781.354554:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426809088 00000100:00100000:0.0:1787856781.354569:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426809088 00000100:00100000:0.0:1787856781.354649:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 363 00000100:00100000:0.0:1787856781.354660:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426809088:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856781.354821:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426809088:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 163us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856781.354829:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 363 00000100:00100000:1.0:1787856781.358771:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856781.358865:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426809216 00000100:00100000:2.0:1787856781.358874:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426809216 00000100:00100000:2.0:1787856781.358930:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 364 00000100:00100000:2.0:1787856781.358940:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+12:10781:x1874703426809216:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856781.359085:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+12:10781:x1874703426809216:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 146us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.359100:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 364 00000100:00100000:1.0:1787856781.369461:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856781.369611:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426809344 00000100:00100000:3.0:1787856781.369621:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426809344 00000100:00100000:3.0:1787856781.369675:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 365 00000100:00100000:3.0:1787856781.369685:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+12:10781:x1874703426809344:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787856781.369831:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+12:10781:x1874703426809344:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 148us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856781.369838:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 365 00000100:00100000:3.0:1787856781.389351:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856781.389534:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426809472 00000100:00100000:0.0:1787856781.389546:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426809472 00000100:00100000:0.0:1787856781.389602:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 366 00000100:00100000:0.0:1787856781.389613:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+12:6174:x1874703426809472:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856781.389630:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856781.389648:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bb200/0xc25410d92a3c3d3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f11 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856781.389676:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bb200/0xc25410d92a3c3d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f11 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856781.389687:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bb200/0xc25410d92a3c3d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f11 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856781.389697:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb200, rc 0) 00000100:00100000:0.0:1787856781.389767:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426809472:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 156us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856781.389775:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 366 00000100:00100000:1.0:1787856781.392877:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856781.392978:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426809600 00000100:00100000:2.0:1787856781.392990:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426809600 00000100:00100000:2.0:1787856781.393055:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 367 00000100:00100000:2.0:1787856781.393065:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426809600:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856781.393208:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426809600:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 144us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.393279:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 367 00000100:00100000:1.0:1787856781.409629:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856781.410639:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426809728 00000100:00100000:3.0:1787856781.410657:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426809728 00000100:00100000:3.0:1787856781.410763:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 368 00000100:00100000:3.0:1787856781.410777:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426809728:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856781.410989:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:6174:x1874703426809728:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 214us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856781.410997:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 368 00000100:00100000:3.0:1787856781.417264:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856781.417349:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426809856 00000100:00100000:0.0:1787856781.417387:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426809856 00000100:00100000:0.0:1787856781.417457:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 369 00000100:00100000:0.0:1787856781.417476:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:10785:x1874703426809856:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787856781.417620:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:10785:x1874703426809856:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 154us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856781.417629:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 369 00000100:00100000:1.0:1787856781.428689:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856781.428847:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426809984 00000100:00100000:3.0:1787856781.428860:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426809984 00000100:00100000:3.0:1787856781.428933:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 370 00000100:00100000:3.0:1787856781.428944:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:10785:x1874703426809984:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787856781.429153:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:10785:x1874703426809984:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 209us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856781.429175:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 370 00000100:00100000:1.0:1787856781.796046:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856781.796102:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856781.796144:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856781.796173:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856781.796198:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856781.796382:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426810112 00000100:00100000:3.0:1787856781.796384:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426810624 00000100:00100000:1.0:1787856781.796396:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426810112 00000100:00100000:3.0:1787856781.796402:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426810624 00000100:00100000:0.0:1787856781.796515:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426810368 00000100:00100000:0.0:1787856781.796522:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426810368 00000100:00100000:0.0:1787856781.796585:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1787856781.796602:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601999e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426810368:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:2.0:1787856781.796607:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787856781.796614:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856781.796617:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856781.796631:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426810240 00000100:00100000:2.0:1787856781.796636:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426810240 00000100:00100000:1.0:1787856781.796709:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426810496 00000100:00100000:1.0:1787856781.796726:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426810496 00000100:00100000:0.0:1787856781.797400:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601999e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426810368:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 800us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856781.797411:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1787856781.797453:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:0.0:1787856781.797463:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426810112:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856781.797507:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426810112:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 46us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856781.797514:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00080000:3.0:1787856781.799560:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856781.799570:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856781.799607:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 237 00000100:00100000:3.0:1787856781.799630:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426810624:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856781.799712:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426810624:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 96us (3568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856781.799719:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 237 00000100:00100000:2.0:1787856781.801503:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:2.0:1787856781.801523:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426810240:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856781.801589:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426810240:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (5415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856781.801596:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:1.0:1787856781.803799:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:1.0:1787856781.803830:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426810496:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856781.803934:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426810496:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 119us (7732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856781.803942:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 239 00000040:00080000:2.0:1787856782.161982:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787856782.172727:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787856782.231864:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856783.249610:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856783.697626:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436336000:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.697731:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856783.697815:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436336512:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.697874:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856783.697902:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436337024:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.697937:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856783.697969:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787856783.697975:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436336128:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.698016:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856783.698039:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436336640:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.698066:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856783.698081:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436337152:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.698111:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856783.698249:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436335744:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698290:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856783.698321:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436336256:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698351:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856783.698376:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436336768:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698405:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856783.698421:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436337280:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698450:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856783.698479:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787856783.698494:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436335872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698525:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856783.698548:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436336384:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698581:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856783.698599:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436336896:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698638:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856783.698671:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436336000 00000100:00100000:3.0:1787856783.698680:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436336000 00000100:00100000:3.0:1787856783.698747:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436336256 00000100:00100000:3.0:1787856783.698751:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436336256 00000100:00100000:3.0:1787856783.698780:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787856783.698795:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436336000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698865:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436336000:12345-0@lo:400:kworker.0 Request processed in 76us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.698873:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787856783.698902:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787856783.698909:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436336256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.698944:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436336256:12345-0@lo:400:kworker.0 Request processed in 36us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.698950:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787856783.698968:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436337152 00000100:00100000:3.0:1787856783.698972:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436337152 00000100:00100000:3.0:1787856783.699017:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436336768 00000100:00100000:3.0:1787856783.699020:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436336768 00000100:00100000:3.0:1787856783.699032:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436337280 00000100:00100000:3.0:1787856783.699034:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436337280 00000100:00100000:3.0:1787856783.699052:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436336384 00000100:00100000:3.0:1787856783.699054:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436336384 00000100:00100000:3.0:1787856783.699074:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787856783.699080:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436337152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699116:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436337152:12345-0@lo:400:kworker.0 Request processed in 37us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.699140:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787856783.699169:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787856783.699174:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436336768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699267:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436336768:12345-0@lo:400:kworker.0 Request processed in 43us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.699274:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787856783.699290:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787856783.699296:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436337280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699329:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436337280:12345-0@lo:400:kworker.0 Request processed in 34us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.699335:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787856783.699350:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787856783.699356:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436336384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699386:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436336384:12345-0@lo:400:kworker.0 Request processed in 30us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.699391:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1787856783.699418:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856783.699423:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787856783.699470:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7a96940 x1874703436336384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856783.699491:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436336384:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699502:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436336256:0@lo:400:kworker.0 00010000:00080000:3.0:1787856783.699517:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7a961c0 x1874703436336768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856783.699525:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436336768:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699555:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436337280:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699637:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436336512 00000100:00100000:3.0:1787856783.699641:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436336512 00000100:00100000:3.0:1787856783.699671:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436337024 00000100:00100000:3.0:1787856783.699674:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436337024 00000100:00100000:3.0:1787856783.699685:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436336128 00000100:00100000:3.0:1787856783.699688:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436336128 00000100:00100000:3.0:1787856783.699699:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436336640 00000100:00100000:3.0:1787856783.699710:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436336640 00000100:00100000:3.0:1787856783.699723:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436335872 00000100:00100000:3.0:1787856783.699726:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436335872 00000100:00100000:3.0:1787856783.699745:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436336896 00000100:00100000:3.0:1787856783.699748:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436336896 00000100:00100000:3.0:1787856783.699772:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787856783.699779:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436336512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699824:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436336512:12345-0@lo:400:kworker.0 Request processed in 46us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.699830:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787856783.699842:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787856783.699848:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436337024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699885:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436337024:12345-0@lo:400:kworker.0 Request processed in 37us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.699890:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787856783.699907:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787856783.699913:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436336128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.699942:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436336128:12345-0@lo:400:kworker.0 Request processed in 29us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.699958:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787856783.699970:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787856783.699975:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436336640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.700004:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436336640:12345-0@lo:400:kworker.0 Request processed in 29us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.700009:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787856783.700018:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787856783.700023:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436335872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.700051:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436335872:12345-0@lo:400:kworker.0 Request processed in 28us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.700056:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787856783.700065:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787856783.700070:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436336896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.700093:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436336896:12345-0@lo:400:kworker.0 Request processed in 23us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856783.700098:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1787856783.700111:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856783.700114:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856783.700131:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436335872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856783.700141:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436336896:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.700612:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436337152:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.700628:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436336000:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.700640:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436336512:0@lo:400:kworker.0 00010000:00080000:0.0:1787856783.700653:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7a970c0 x1874703436337024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856783.700663:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436337024:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.700686:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436336128:0@lo:400:kworker.0 00010000:00080000:0.0:1787856783.700697:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7a95680 x1874703436336640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856783.700706:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436336640:0@lo:400:kworker.0 00000100:00100000:1.0:1787856783.700894:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856783.700908:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436337408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856783.700965:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856783.702391:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436337408 00000100:00100000:0.0:1787856783.702400:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436337408 00000100:00100000:0.0:1787856783.702462:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787856783.702471:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436337408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856783.702528:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856783.702608:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436337408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856783.702616:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787856783.702711:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856783.702728:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436337536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856783.702771:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856783.702858:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436337408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856783.703020:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436337664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856783.703069:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856783.703105:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436335744 00000100:00100000:2.0:1787856783.703109:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436335744 00000100:00100000:2.0:1787856783.703151:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787856783.703166:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436335744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856783.703249:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436335744:12345-0@lo:400:kworker.0 Request processed in 85us (4958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856783.703257:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787856783.703297:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436335744:0@lo:400:kworker.0 00000100:00100000:0.0:1787856783.703563:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436337536 00000100:00100000:0.0:1787856783.703568:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436337536 00000100:00100000:0.0:1787856783.703603:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436337664 00000100:00100000:0.0:1787856783.703606:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436337664 00000100:00100000:0.0:1787856783.703619:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787856783.703625:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436337536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856783.703646:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856783.703693:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436337536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856783.703699:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787856783.703712:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787856783.703717:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436337664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856783.703728:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856783.703751:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436337664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856783.703757:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787856783.706270:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436337664:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787856783.706304:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a20780 x1874703436337536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856783.706320:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436337536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856784.211924:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436337792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856784.212043:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856784.212250:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436337792 00000100:00100000:0.0:1787856784.212264:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436337792 00000100:00100000:0.0:1787856784.213028:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787856784.213043:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436337792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856784.213103:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856784.213210:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436337792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856784.213255:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1787856784.213724:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2f840 x1874703436337792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856784.213746:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436337792:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787856784.218989:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1787856784.273884:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856784.722095:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436337920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856784.722172:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856784.722434:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436337920 00000100:00100000:3.0:1787856784.722443:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436337920 00000100:00100000:3.0:1787856784.722540:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787856784.722549:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436337920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856784.722594:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856784.722656:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436337920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856784.722665:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787856784.722772:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436337920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856785.238201:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856785.238264:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436338048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856785.238344:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856785.238699:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436338048 00000100:00100000:3.0:1787856785.238709:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436338048 00000100:00100000:3.0:1787856785.238774:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787856785.238783:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436338048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856785.238819:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856785.238879:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436338048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856785.238886:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787856785.238931:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436338048:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787856785.297607:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856786.321596:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856786.908299:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856786.908445:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856786.908482:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856786.908521:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856786.908553:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856786.908891:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426811008 00000100:00100000:2.0:1787856786.908908:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426811008 00000100:00100000:3.0:1787856786.908921:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856786.908975:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426811264 00000100:00100000:3.0:1787856786.908984:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426811264 00000100:00100000:2.0:1787856786.908995:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426810880 00000100:00100000:2.0:1787856786.909001:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426810880 00000100:00100000:3.0:1787856786.909038:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426811392 00000100:00100000:3.0:1787856786.909044:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426811392 00000100:00100000:2.0:1787856786.909062:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 246 00000100:00100000:2.0:1787856786.909087:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426811008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856786.909110:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 247 00000100:00100000:3.0:1787856786.909120:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426811264:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856786.909189:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426811008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 109us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856786.909198:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 246 00000100:00100000:3.0:1787856786.909356:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426811264:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 235us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856786.909366:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 247 00000100:00100000:3.0:1787856786.909385:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 248 00000100:00100000:3.0:1787856786.909392:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426810880:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856786.909419:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426810880:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856786.909425:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 248 00000100:00100000:3.0:1787856786.909438:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 249 00000100:00100000:3.0:1787856786.909445:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426811392:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856786.909469:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426811392:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856786.909475:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 249 00000100:00100000:3.0:1787856786.909497:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426811136 00000100:00100000:3.0:1787856786.909500:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426811136 00000100:00100000:3.0:1787856786.909533:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:3.0:1787856786.909541:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426811136:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856786.909570:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426811136:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856786.909580:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00080000:3.0:1787856786.909604:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856786.909609:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856786.909612:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856786.910002:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426810752 00000100:00100000:0.0:1787856786.910009:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426810752 00000100:00100000:0.0:1787856786.910059:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 372 00000100:00100000:0.0:1787856786.910068:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426810752:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856786.910113:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426810752:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 47us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856786.910120:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 372 00010000:00010000:0.0:1787856787.345856:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856788.369720:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856788.818530:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436338176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856788.818638:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856788.818665:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436338432:0@lo:400:kworker.0 00000100:00100000:3.0:1787856788.818702:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856788.818732:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436338944:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.818746:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436338688:0@lo:400:kworker.0 00000100:00100000:3.0:1787856788.818763:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856788.818824:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436338304:0@lo:400:kworker.0 00000100:00100000:2.0:1787856788.818993:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436338560:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.824587:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856788.824626:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436339456:0@lo:400:kworker.0 00000100:00100000:2.0:1787856788.824654:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856788.824658:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436339200:0@lo:400:kworker.0 00000100:00100000:3.0:1787856788.824696:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856788.824759:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856788.824765:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436339072:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.824784:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436339712:0@lo:400:kworker.0 00000100:00100000:3.0:1787856788.824798:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436339968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856788.824818:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856788.824833:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856788.824864:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436338944 00000100:00100000:3.0:1787856788.824872:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436339712 00000100:00100000:0.0:1787856788.824873:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436338944 00000100:00100000:3.0:1787856788.824878:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436339712 00000100:00100000:2.0:1787856788.824916:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856788.824958:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436339584:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.824962:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787856788.824974:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436338944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856788.824999:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856788.825060:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436338944:12345-0@lo:400:kworker.0 Request processed in 86us (6295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856788.825086:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787856788.825115:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787856788.825121:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436339712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856788.825123:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436338432 00000100:00100000:2.0:1787856788.825132:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436338432 00000100:00100000:0.0:1787856788.825175:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436339712:12345-0@lo:400:kworker.0 Request processed in 49us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856788.825183:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787856788.825193:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436338688 00000100:00100000:2.0:1787856788.825199:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436338688 00000100:00100000:0.0:1787856788.825238:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436339456 00000100:00100000:0.0:1787856788.825243:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436339456 00000100:00080000:3.0:1787856788.825251:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856788.825257:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856788.825260:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856788.825267:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436339200 00000100:00100000:3.0:1787856788.825270:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436339072 00000100:00100000:0.0:1787856788.825271:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436339200 00000100:00100000:3.0:1787856788.825277:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436339072 00000100:00100000:0.0:1787856788.825293:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436339584 00000100:00100000:0.0:1787856788.825296:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436339584 00000100:00100000:3.0:1787856788.825305:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787856788.825314:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436338432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.825319:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787856788.825326:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436339456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856788.825353:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436338432:12345-0@lo:400:kworker.0 Request processed in 42us (6651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856788.825359:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787856788.825363:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436339456:12345-0@lo:400:kworker.0 Request processed in 38us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856788.825369:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787856788.825374:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787856788.825382:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436339200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.825386:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787856788.825394:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436339072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856788.825416:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436339200:12345-0@lo:400:kworker.0 Request processed in 35us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856788.825422:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787856788.825429:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436339072:12345-0@lo:400:kworker.0 Request processed in 35us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856788.825434:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787856788.825439:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787856788.825446:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436339584:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787856788.825449:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856788.825452:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856788.825483:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436338432:0@lo:400:kworker.0 00000100:00100000:3.0:1787856788.825485:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436339584:12345-0@lo:400:kworker.0 Request processed in 40us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856788.825493:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00010000:00080000:0.0:1787856788.825502:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7a94780 x1874703436338944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856788.825518:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436338944:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.825528:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436339456:0@lo:400:kworker.0 00000100:00100000:3.0:1787856788.825543:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436338560 00000100:00100000:3.0:1787856788.825547:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436338560 00000100:00100000:0.0:1787856788.825576:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436338176 00000100:00100000:0.0:1787856788.825580:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436338176 00000100:00100000:3.0:1787856788.825581:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787856788.825590:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436338560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.825618:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436339968 00000100:00100000:0.0:1787856788.825621:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436339968 00000100:00100000:3.0:1787856788.825622:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436338560:12345-0@lo:400:kworker.0 Request processed in 34us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856788.825629:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787856788.825644:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787856788.825650:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436338176:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856788.825658:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436340096:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856788.825676:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856788.825681:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856788.825715:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436338176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (7080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856788.825722:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787856788.825723:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436338560:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.825732:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436340096 00000100:00100000:0.0:1787856788.825735:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436340096 00000100:00100000:3.0:1787856788.825746:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436339072:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.825746:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787856788.825753:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436339968:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787856788.825766:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7bec780 x1874703436339584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1787856788.825768:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856788.825785:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436339584:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.825792:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436339968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856788.825798:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787856788.825810:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787856788.825814:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436340096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856788.825820:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787856788.825843:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7a94b40 x1874703436339200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856788.825845:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436340096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856788.825860:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436339200:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.825865:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787856788.825881:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436339712:0@lo:400:kworker.0 00000100:00080000:0.0:1787856788.825884:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856788.825889:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856788.825900:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787856788.825907:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9065fe80de00, transno 4294967301 00010000:00080000:0.0:1787856788.825907:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a21680 x1874703436339968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856788.825920:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436339968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856788.826370:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856788.826407:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436338816:0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.826444:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856788.826468:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436338816 00000100:00100000:1.0:1787856788.826473:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436338816 00000100:00100000:1.0:1787856788.826503:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787856788.826510:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436338816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.826544:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436338816:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856788.826551:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787856788.826579:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436338816:0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.826587:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436339328:0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.826610:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856788.826633:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436339328 00000100:00100000:1.0:1787856788.826637:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436339328 00000100:00100000:1.0:1787856788.826661:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787856788.826667:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436339328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.826709:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436339328:12345-0@lo:400:kworker.0 Request processed in 41us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856788.826716:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1787856788.826742:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7beda40 x1874703436339328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856788.826752:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436339328:0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.826760:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436339840:0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.826781:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856788.826832:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436339840 00000100:00100000:1.0:1787856788.826835:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436339840 00000100:00100000:1.0:1787856788.826859:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787856788.826865:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436339840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.826899:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436339840:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856788.826921:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787856788.826990:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787856788.827007:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436338688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.827039:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436338304 00000100:00100000:0.0:1787856788.827046:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436338304 00000100:00100000:0.0:1787856788.827078:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787856788.827083:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436338304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.827361:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436340096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856788.827427:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436338176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856788.834554:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436338688:12345-0@lo:400:kworker.0 Request processed in 7541us (9969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856788.834573:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787856788.834627:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436338688:0@lo:400:kworker.0 00000100:00100000:0.0:1787856788.834627:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436338304:12345-0@lo:400:kworker.0 Request processed in 7537us (8253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856788.834645:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787856788.834708:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436339840:0@lo:400:kworker.0 00000100:00100000:1.0:1787856788.834723:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436338304:0@lo:400:kworker.0 00000100:00100000:1.0:1787856789.330182:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856789.330298:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436340224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856789.330488:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856789.330536:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436340224 00000100:00100000:0.0:1787856789.330549:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436340224 00000100:00100000:0.0:1787856789.330621:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787856789.330633:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436340224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856789.330662:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856789.338097:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436340224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7455us (7599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856789.338115:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1787856789.338374:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2c3c0 x1874703436340224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856789.338408:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436340224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787856789.394329:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856789.841635:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856789.841691:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436340352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856789.841809:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856789.842078:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436340352 00000100:00100000:3.0:1787856789.842089:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436340352 00000100:00100000:3.0:1787856789.842180:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787856789.842192:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436340352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856789.842261:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856789.842317:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436340352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856789.842324:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787856789.842824:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436340352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856790.353697:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436340480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856790.353824:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856790.354651:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436340480 00000100:00100000:3.0:1787856790.354663:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436340480 00000100:00100000:3.0:1787856790.354734:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787856790.354746:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436340480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856790.354806:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856790.354884:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436340480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856790.354891:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787856790.355387:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436340480:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856790.417562:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856791.441515:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856792.028030:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856792.028082:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856792.028195:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856792.028288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856792.028313:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856792.028334:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856792.028363:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426811776 00000100:00100000:3.0:1787856792.028373:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426811776 00000100:00100000:3.0:1787856792.028426:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426812032 00000100:00100000:3.0:1787856792.028442:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426812032 00000100:00100000:3.0:1787856792.028457:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426811648 00000100:00100000:3.0:1787856792.028459:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426811648 00000100:00100000:3.0:1787856792.028471:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426812160 00000100:00100000:3.0:1787856792.028474:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426812160 00000100:00100000:3.0:1787856792.028489:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 256 00000100:00100000:3.0:1787856792.028497:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426811776:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856792.028589:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426811776:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 91us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856792.028596:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 256 00000100:00100000:3.0:1787856792.028614:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 257 00000100:00100000:3.0:1787856792.028620:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426812032:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856792.028761:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 258 00000100:00100000:1.0:1787856792.028772:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426811648:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856792.028804:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426811648:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 36us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856792.028810:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 258 00000100:00100000:1.0:1787856792.028825:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 259 00000100:00100000:1.0:1787856792.028832:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426812160:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856792.028857:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426812160:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856792.028863:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 259 00000100:00100000:1.0:1787856792.028882:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426811904 00000100:00100000:1.0:1787856792.028886:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426811904 00000100:00100000:1.0:1787856792.028918:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:1.0:1787856792.028925:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426811904:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856792.028949:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426811904:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856792.028956:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00080000:0.0:1787856792.029262:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856792.029269:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856792.029271:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856792.030920:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426812032:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 2292us (2717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856792.030932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 257 00000100:00100000:2.0:1787856792.031149:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426811520 00000100:00100000:2.0:1787856792.031156:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426811520 00000100:00100000:2.0:1787856792.031206:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 374 00000100:00100000:2.0:1787856792.031247:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426811520:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856792.031286:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426811520:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 72us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856792.031308:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 374 00000040:00080000:0.0:1787856792.402000:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787856792.402864:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787856792.465378:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856793.489575:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856793.937535:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436340608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856793.937615:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856793.937768:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436340608 00000100:00100000:0.0:1787856793.937777:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436340608 00000100:00100000:0.0:1787856793.937837:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787856793.937847:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436340608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856793.937876:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787856793.937909:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856793.937918:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436340608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856793.937925:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1787856793.938076:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a21680 x1874703436340608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856793.938104:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436340608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856793.938122:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856793.938144:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436340736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856793.938170:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856793.938517:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436340992:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.938551:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856793.938570:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436341504:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.938596:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856793.938611:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436342016:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.938630:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856793.938646:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787856793.938650:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436340864:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.938672:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856793.938689:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436341376:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.938707:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856793.938719:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436341888:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.938739:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856793.938849:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436341248:0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.938879:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856793.938895:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436341760:0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.938914:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856793.938926:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787856793.938931:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436341120:0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.938948:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856793.938958:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436341632:0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.938977:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856793.938985:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436342144:0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.939015:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856793.939043:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436341376 00000100:00100000:3.0:1787856793.939048:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436341376 00000100:00100000:3.0:1787856793.939073:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436341120 00000100:00100000:3.0:1787856793.939076:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436341120 00000100:00100000:3.0:1787856793.939091:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787856793.939110:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436341376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.939155:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436341376:12345-0@lo:400:kworker.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856793.939162:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787856793.939176:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787856793.939182:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436341120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.939236:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436341120:12345-0@lo:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856793.939243:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787856793.939391:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436341504 00000100:00100000:1.0:1787856793.939395:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436341504 00000100:00100000:1.0:1787856793.939427:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436342144 00000100:00100000:1.0:1787856793.939429:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436342144 00000100:00100000:1.0:1787856793.939448:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787856793.939454:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436341504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856793.939486:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436341504:12345-0@lo:400:kworker.0 Request processed in 33us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856793.939492:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787856793.939502:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787856793.939508:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436342144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856793.939529:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436342144:12345-0@lo:400:kworker.0 Request processed in 22us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856793.939534:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787856793.939552:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436340992 00000100:00100000:1.0:1787856793.939555:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436340992 00000100:00100000:1.0:1787856793.939570:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436342016 00000100:00100000:1.0:1787856793.939572:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436342016 00000100:00100000:1.0:1787856793.939582:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436341888 00000100:00100000:1.0:1787856793.939584:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436341888 00000100:00100000:1.0:1787856793.939594:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436341248 00000100:00100000:1.0:1787856793.939596:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436341248 00000100:00100000:1.0:1787856793.939606:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436341760 00000100:00100000:1.0:1787856793.939608:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436341760 00000100:00100000:1.0:1787856793.939617:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436341632 00000100:00100000:1.0:1787856793.939620:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436341632 00000100:00100000:1.0:1787856793.939631:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787856793.939636:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436340992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856793.939670:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436340992:12345-0@lo:400:kworker.0 Request processed in 33us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856793.939676:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787856793.939686:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787856793.939692:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436342016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856793.939712:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436342016:12345-0@lo:400:kworker.0 Request processed in 21us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856793.939717:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787856793.939726:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787856793.939731:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436341888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856793.939752:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436341888:12345-0@lo:400:kworker.0 Request processed in 21us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856793.939872:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436340736 00000100:00100000:0.0:1787856793.939877:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436340736 00000100:00100000:0.0:1787856793.939907:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787856793.939914:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436340736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856793.939933:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856793.939969:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436340736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856793.939974:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787856793.939993:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787856793.940000:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436341248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856793.940030:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436341248:12345-0@lo:400:kworker.0 Request processed in 30us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856793.940036:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787856793.940048:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787856793.940054:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436341760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856793.940078:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436341760:12345-0@lo:400:kworker.0 Request processed in 25us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856793.940106:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787856793.940119:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787856793.940124:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436341632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856793.940154:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436341632:12345-0@lo:400:kworker.0 Request processed in 31us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856793.940160:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787856793.940180:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436340864 00000100:00100000:0.0:1787856793.940183:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436340864 00000100:00100000:0.0:1787856793.940209:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787856793.940234:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436340864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.940369:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436342272:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787856793.940472:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856793.940478:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856793.940480:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787856793.940482:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856793.940514:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436341376:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.940527:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436341888:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.940538:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436340992:0@lo:400:kworker.0 00010000:00080000:2.0:1787856793.940551:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2de00 x1874703436341504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856793.940572:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436341504:0@lo:400:kworker.0 00010000:00080000:2.0:1787856793.940585:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d9e62940 x1874703436342016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856793.940594:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436342016:0@lo:400:kworker.0 00000100:00100000:2.0:1787856793.940752:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436340736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856793.940867:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787856793.945826:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856793.945941:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436341120:0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.945958:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436341632:0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.945969:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436342144:0@lo:400:kworker.0 00000100:00100000:3.0:1787856793.945982:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436341248:0@lo:400:kworker.0 00010000:00080000:3.0:1787856793.945996:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2ed00 x1874703436341760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856793.946007:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436341760:0@lo:400:kworker.0 00000100:00100000:0.0:1787856793.946951:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436340864:12345-0@lo:400:kworker.0 Request processed in 6731us (8273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856793.946965:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1787856793.949561:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436340864:0@lo:400:kworker.0 00000100:00100000:1.0:1787856793.954938:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436342272 00000100:00100000:1.0:1787856793.954954:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436342272 00000100:00100000:1.0:1787856793.955112:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787856793.955123:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436342272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856793.955156:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856793.955281:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436342272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (9461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856793.955288:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787856793.955386:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436342272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856794.449727:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436342400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856794.449941:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856794.450100:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436342400 00000100:00100000:2.0:1787856794.450108:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436342400 00000100:00100000:2.0:1787856794.450164:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787856794.450173:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436342400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856794.450197:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856794.450284:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436342400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856794.450292:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1787856794.450478:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d9e60000 x1874703436342400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856794.450498:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436342400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856794.513533:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856794.961643:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856794.962210:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436342528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856794.962329:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856794.962582:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436342528 00000100:00100000:2.0:1787856794.962591:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436342528 00000100:00100000:2.0:1787856794.962646:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787856794.962656:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436342528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787856794.962689:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787856794.962760:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436342528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856794.962769:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787856794.963151:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436342528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856795.473864:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856795.473887:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436342656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856795.473961:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856795.474389:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436342656 00000100:00100000:1.0:1787856795.474397:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436342656 00000100:00100000:1.0:1787856795.474451:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787856795.474461:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436342656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856795.474497:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856795.474563:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436342656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856795.474571:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787856795.474788:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436342656:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787856795.539681:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856796.563366:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856797.149332:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856797.149379:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856797.149426:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856797.149528:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426812544 00000100:00100000:2.0:1787856797.149540:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426812544 00000100:00100000:0.0:1787856797.149543:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426812416 00000100:00100000:0.0:1787856797.149549:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426812416 00000100:00100000:1.0:1787856797.149621:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426812288 00000100:00100000:1.0:1787856797.149626:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426812288 00000100:00100000:2.0:1787856797.149633:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 266 00000100:00100000:2.0:1787856797.149646:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426812544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856797.149663:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 376 00000100:00100000:1.0:1787856797.149672:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426812288:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856797.149731:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426812288:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 60us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856797.149738:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 376 00000100:00100000:0.0:1787856797.150508:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 267 00000100:00100000:0.0:1787856797.150518:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426812416:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856797.151947:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426812544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 2294us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856797.151961:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 266 00000100:00080000:3.0:1787856797.152378:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856797.152385:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856797.159479:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426812416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 8948us (10038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856797.159496:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 267 00000100:00100000:3.0:1787856797.166833:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856797.166882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856797.166922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856797.166999:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426812800 00000100:00100000:0.0:1787856797.167010:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426812800 00000100:00100000:0.0:1787856797.167106:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426812928 00000100:00100000:0.0:1787856797.167110:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426812928 00000100:00080000:3.0:1787856797.167139:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856797.167144:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 268 00000100:00080000:3.0:1787856797.167146:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856797.167157:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426812800:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856797.167185:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 269 00000100:00100000:3.0:1787856797.167197:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426812928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856797.167275:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426812928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856797.167448:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 269 00000100:00100000:0.0:1787856797.167530:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426812800:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 374us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856797.167538:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 268 00000100:00100000:1.0:1787856797.168009:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426812672 00000100:00100000:1.0:1787856797.168014:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426812672 00000100:00100000:1.0:1787856797.168094:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1787856797.168106:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2398:x1874703426812672:12345-192.168.202.6@tcp:9:kworker.0 00000100:00080000:3.0:1787856797.168121:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1787856797.168126:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3c64 00000100:00080000:1.0:1787856797.168135:0:8410:0:(import.c:65:import_set_state_nolock()) ffff9064c8089000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787856797.168701:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1787856797.168854:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+2:2398:x1874703426812672:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 748us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856797.168863:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00010000:00010000:3.0:1787856797.170432:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856797.585469:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856798.609876:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856799.057972:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856799.058009:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436342784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856799.058097:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856799.058166:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436342784 00000100:00100000:1.0:1787856799.058173:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436342784 00000100:00100000:1.0:1787856799.058243:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787856799.058254:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436342784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856799.058297:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856799.058345:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436342784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856799.058353:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787856799.058398:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436342784:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787856799.058532:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856799.062013:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436343040:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.062102:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.062147:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436343552:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.062173:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.062206:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436344064:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.062270:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.062302:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787856799.062310:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436342912:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.062338:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.062360:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436343424:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.062385:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.062412:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436343936:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.062436:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.062455:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601998780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436344448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856799.062917:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.062960:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436343552 00000100:00100000:2.0:1787856799.062968:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436343552 00000100:00100000:3.0:1787856799.063022:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436343040 00000100:00100000:2.0:1787856799.063032:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436343936 00000100:00100000:2.0:1787856799.063035:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436343936 00000100:00100000:3.0:1787856799.063039:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436343040 00000100:00100000:2.0:1787856799.063069:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787856799.063078:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436343552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063083:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436344064 00000100:00100000:3.0:1787856799.063086:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436344064 00000100:00100000:3.0:1787856799.063105:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787856799.063110:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436343040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.063133:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436343552:12345-0@lo:400:kworker.0 Request processed in 56us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856799.063140:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787856799.063141:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436343040:12345-0@lo:400:kworker.0 Request processed in 32us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.063147:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787856799.063154:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787856799.063156:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787856799.063160:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436343936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063161:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7062940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436344064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063184:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7062940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436344064:12345-0@lo:400:kworker.0 Request processed in 23us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856799.063184:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436343936:12345-0@lo:400:kworker.0 Request processed in 24us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.063190:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787856799.063190:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787856799.063211:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436344448 00000100:00100000:2.0:1787856799.063214:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436344448 00000100:00100000:2.0:1787856799.063258:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787856799.063264:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436344448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856799.063278:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856799.063303:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436343296:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.063306:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436344448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856799.063311:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787856799.063330:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856799.063347:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436343808:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063365:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856799.063379:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436344320:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063398:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.063400:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436343296 00000100:00100000:2.0:1787856799.063403:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436343296 00000100:00100000:3.0:1787856799.063416:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787856799.063420:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436343808 00000100:00100000:3.0:1787856799.063422:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436343168:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.063422:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436343808 00000100:00100000:2.0:1787856799.063434:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787856799.063440:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436343296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063444:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856799.063461:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436343680:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063482:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856799.063493:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436344192:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063514:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856799.063549:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436343296:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063573:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436343680 00000100:00100000:3.0:1787856799.063576:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436343680 00000100:00100000:3.0:1787856799.063592:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436344192 00000100:00100000:3.0:1787856799.063595:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436344192 00000100:00100000:3.0:1787856799.063625:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787856799.063631:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436343808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063665:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436343808:12345-0@lo:400:kworker.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.063671:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787856799.063684:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787856799.063689:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436343680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.063994:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436343680:12345-0@lo:400:kworker.0 Request processed in 303us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.064001:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787856799.064013:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787856799.064019:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436344192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064067:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436344192:12345-0@lo:400:kworker.0 Request processed in 48us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856799.064070:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436343296:12345-0@lo:400:kworker.0 Request processed in 630us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.064073:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787856799.064083:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787856799.064092:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436343424 00000100:00100000:3.0:1787856799.064095:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436343424 00000100:00080000:2.0:1787856799.064100:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856799.064105:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787856799.064106:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856799.064109:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856799.064110:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436343168 00000100:00100000:3.0:1787856799.064112:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436343168 00000100:00100000:3.0:1787856799.064122:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787856799.064128:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436343424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064158:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436343424:12345-0@lo:400:kworker.0 Request processed in 31us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.064170:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787856799.064181:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787856799.064187:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436343168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064214:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436343168:12345-0@lo:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.064244:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787856799.064270:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436343168:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.064284:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436343424:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064288:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436343680:0@lo:400:kworker.0 00010000:00080000:3.0:1787856799.064298:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2f840 x1874703436344192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787856799.064298:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2de00 x1874703436343936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856799.064309:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436344192:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.064309:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436343936:0@lo:400:kworker.0 00010000:00080000:3.0:1787856799.064319:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2e940 x1874703436343808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856799.064325:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601998780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436344448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856799.064326:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436343808:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.064336:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436343040:0@lo:400:kworker.0 00010000:00080000:2.0:1787856799.064347:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2c3c0 x1874703436343552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856799.064348:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436344320 00000100:00100000:3.0:1787856799.064351:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436344320 00000100:00100000:2.0:1787856799.064355:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436343552:0@lo:400:kworker.0 00000100:00100000:2.0:1787856799.064366:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436344064:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064375:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787856799.064380:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436344320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064414:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436344320:12345-0@lo:400:kworker.0 Request processed in 34us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.064420:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787856799.064440:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436344320:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064481:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436342912 00000100:00100000:3.0:1787856799.064490:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436342912 00000100:00100000:3.0:1787856799.064519:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787856799.064525:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436342912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064562:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436342912:12345-0@lo:400:kworker.0 Request processed in 37us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856799.064568:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787856799.064627:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436342912:0@lo:400:kworker.0 00000100:00100000:3.0:1787856799.064678:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436344576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856799.064882:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.064912:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436344576 00000100:00100000:2.0:1787856799.064916:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436344576 00000100:00100000:2.0:1787856799.064942:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787856799.064949:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436344576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856799.064971:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856799.065006:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436344576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (301us total) trans 0 rc 0/0 00010000:00080000:3.0:1787856799.065105:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2c000 x1874703436344576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856799.065119:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436344576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856799.065187:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787856799.570245:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856799.570269:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436344704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856799.570339:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856799.570762:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436344704 00000100:00100000:2.0:1787856799.570770:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436344704 00000100:00100000:2.0:1787856799.570825:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787856799.570835:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436344704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856799.570863:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856799.570922:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436344704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856799.570929:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:0.0:1787856799.571035:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d9e62940 x1874703436344704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856799.571066:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436344704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787856799.637762:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856800.081571:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856800.081596:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436344832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856800.081668:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856800.083576:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436344832 00000100:00100000:3.0:1787856800.083591:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436344832 00000100:00100000:3.0:1787856800.083661:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787856800.083672:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436344832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856800.083711:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856800.083802:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436344832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856800.083810:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787856800.084198:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436344832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856800.593796:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436344960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856800.593985:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856800.594234:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436344960 00000100:00100000:3.0:1787856800.594246:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436344960 00000100:00100000:3.0:1787856800.594309:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787856800.594320:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436344960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856800.594374:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787856800.594433:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436344960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856800.594441:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787856800.594495:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436344960:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787856800.657505:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856801.683669:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856802.275083:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856802.275143:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856802.275177:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856802.275192:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856802.275207:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856802.275257:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426813312 00000100:00100000:3.0:1787856802.275266:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426813312 00000100:00100000:3.0:1787856802.275319:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426813568 00000100:00100000:3.0:1787856802.275322:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426813568 00000100:00100000:3.0:1787856802.275334:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426813184 00000100:00100000:3.0:1787856802.275336:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426813184 00000100:00100000:3.0:1787856802.275348:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426813440 00000100:00100000:3.0:1787856802.275350:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426813440 00000100:00100000:3.0:1787856802.275366:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 276 00000100:00100000:3.0:1787856802.275375:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426813312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856802.275450:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426813312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856802.275472:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 276 00000100:00100000:3.0:1787856802.275503:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00100000:3.0:1787856802.275510:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426813568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856802.275540:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426813568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856802.275545:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00100000:3.0:1787856802.275556:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 278 00000100:00100000:3.0:1787856802.275561:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426813184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856802.275582:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426813184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856802.275588:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 278 00000100:00100000:3.0:1787856802.275599:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:3.0:1787856802.275604:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426813440:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856802.275625:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426813440:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 21us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856802.275630:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:2.0:1787856802.276393:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426813056 00000100:00100000:2.0:1787856802.276401:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426813056 00000100:00100000:2.0:1787856802.276460:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 378 00000100:00100000:2.0:1787856802.276470:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426813056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856802.276520:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426813056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 53us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856802.276526:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 378 00000100:00080000:2.0:1787856802.276565:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856802.276571:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1787856802.645616:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787856802.649544:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787856802.705434:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787856803.158771:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:0.0:1787856803.158779:0:9490:0:(genops.c:885:class_export_put()) final put ffff9064c802d000/898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:1.0:1787856803.158926:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c802d000/898e91b3-529b-44bc-a821-726bff6c71d4 for lustre-OST0001 00000020:00000080:1.0:1787856803.158980:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c8089000 for lustre-OST0001 00010000:00010000:2.0:1787856803.731244:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856804.180286:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436345088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856804.180358:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856804.180436:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436345088 00000100:00100000:2.0:1787856804.180443:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436345088 00000100:00100000:2.0:1787856804.180505:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787856804.180516:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601998780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436345088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856804.180543:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856804.180586:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601998780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436345088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856804.180592:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1787856804.180613:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856804.180648:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436345088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856804.181079:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c79261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436345344:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181119:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181146:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436345856:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181175:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181193:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065cd6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436346368:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181238:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181263:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787856804.181268:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436345216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856804.181291:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181308:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436345728:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181348:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181366:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9c78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436346240:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181386:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181402:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8216d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436346752:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181446:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436345600:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181466:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181481:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436346112:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181501:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181517:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8216940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436346624:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181537:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181554:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787856804.181559:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436345472:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181580:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181597:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436345984:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181615:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181634:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8215a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436346496:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181655:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856804.181676:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436345344 00000100:00100000:1.0:1787856804.181681:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436345344 00000100:00100000:1.0:1787856804.181718:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787856804.181726:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436345344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181765:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436345344:12345-0@lo:400:kworker.0 Request processed in 40us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.181780:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787856804.181811:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436345856 00000100:00100000:1.0:1787856804.181815:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436345856 00000100:00100000:1.0:1787856804.181831:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436345600 00000100:00100000:1.0:1787856804.181849:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436345600 00000100:00100000:1.0:1787856804.181865:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787856804.181871:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436345856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181906:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436345856:12345-0@lo:400:kworker.0 Request processed in 34us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.181911:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787856804.181923:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787856804.181929:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436345600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.181961:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436345600:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.181966:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787856804.181982:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436346368 00000100:00100000:1.0:1787856804.181985:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436346368 00000100:00100000:1.0:1787856804.182025:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436346752 00000100:00100000:1.0:1787856804.182028:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436346752 00000100:00100000:1.0:1787856804.182042:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436345984 00000100:00100000:1.0:1787856804.182044:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436345984 00000100:00100000:1.0:1787856804.182058:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787856804.182063:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436346368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182095:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436346368:12345-0@lo:400:kworker.0 Request processed in 32us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182101:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787856804.182113:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787856804.182127:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436346752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182155:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436346752:12345-0@lo:400:kworker.0 Request processed in 29us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182160:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787856804.182172:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787856804.182178:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436345984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182204:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436345984:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182210:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787856804.182262:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436345216 00000100:00100000:1.0:1787856804.182266:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436345216 00000100:00100000:1.0:1787856804.182289:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787856804.182295:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436345216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856804.182314:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856804.182344:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436345216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182349:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787856804.182368:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436345728 00000100:00100000:1.0:1787856804.182371:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436345728 00000100:00100000:1.0:1787856804.182388:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436346240 00000100:00100000:1.0:1787856804.182391:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436346240 00000100:00100000:1.0:1787856804.182403:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436346112 00000100:00100000:1.0:1787856804.182405:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436346112 00000100:00100000:1.0:1787856804.182415:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436346624 00000100:00100000:1.0:1787856804.182418:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436346624 00000100:00100000:1.0:1787856804.182430:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436345472 00000100:00100000:1.0:1787856804.182432:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436345472 00000100:00100000:1.0:1787856804.182443:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436346496 00000100:00100000:1.0:1787856804.182445:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436346496 00000100:00100000:1.0:1787856804.182471:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787856804.182477:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182508:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436345728:12345-0@lo:400:kworker.0 Request processed in 31us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182514:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787856804.182526:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787856804.182532:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436346240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182561:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436346240:12345-0@lo:400:kworker.0 Request processed in 29us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182567:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787856804.182578:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787856804.182584:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436346112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182611:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436346112:12345-0@lo:400:kworker.0 Request processed in 28us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182617:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787856804.182628:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787856804.182634:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436346624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182662:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436346624:12345-0@lo:400:kworker.0 Request processed in 28us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182667:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787856804.182678:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787856804.182683:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436345472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182707:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436345472:12345-0@lo:400:kworker.0 Request processed in 24us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182712:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787856804.182731:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787856804.182737:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436346496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182766:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436346496:12345-0@lo:400:kworker.0 Request processed in 29us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856804.182772:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1787856804.182820:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856804.182824:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856804.182826:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787856804.182828:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856804.182860:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436345472:0@lo:400:kworker.0 00010000:00080000:1.0:1787856804.182874:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826f0c0 x1874703436345984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856804.182884:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436345984:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182894:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8215a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436346496:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182904:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436345600:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.182913:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436346112:0@lo:400:kworker.0 00010000:00080000:1.0:1787856804.182922:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8216940 x1874703436346624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856804.182930:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8216940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436346624:0@lo:400:kworker.0 00010000:00080000:1.0:1787856804.182967:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7927480 x1874703436345216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856804.182982:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436345216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856804.182994:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436345728:0@lo:400:kworker.0 00010000:00080000:1.0:1787856804.183026:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d9c78b40 x1874703436346240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856804.183035:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9c78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436346240:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.183044:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8216d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436346752:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.183053:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c79261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436345344:0@lo:400:kworker.0 00000100:00100000:1.0:1787856804.183063:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436345856:0@lo:400:kworker.0 00010000:00080000:1.0:1787856804.183071:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065cd6df480 x1874703436346368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856804.183079:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065cd6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436346368:0@lo:400:kworker.0 00000100:00100000:3.0:1787856804.195426:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436346880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856804.195502:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856804.195592:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436346880 00000100:00100000:2.0:1787856804.195601:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436346880 00000100:00100000:2.0:1787856804.195656:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787856804.195668:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436346880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787856804.195689:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856804.195736:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436346880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856804.195743:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787856804.195824:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436346880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856804.691473:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436347008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856804.691546:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856804.691620:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436347008 00000100:00100000:2.0:1787856804.691629:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436347008 00000100:00100000:2.0:1787856804.691678:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787856804.691688:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436347008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856804.691712:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856804.691755:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436347008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856804.691762:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1787856804.691817:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d9e62940 x1874703436347008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856804.691850:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436347008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856804.753541:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856805.201953:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856805.201985:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436347136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856805.202100:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856805.202313:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436347136 00000100:00100000:1.0:1787856805.202386:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436347136 00000100:00100000:1.0:1787856805.202494:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787856805.202506:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436347136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856805.202558:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787856805.202627:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436347136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856805.202637:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787856805.202717:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436347136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856805.725025:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856805.725061:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436347264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856805.725193:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856805.725314:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436347264 00000100:00100000:2.0:1787856805.725324:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436347264 00000100:00100000:2.0:1787856805.725380:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787856805.725389:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436347264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856805.725432:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787856805.725486:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436347264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856805.725493:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787856805.725551:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436347264:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787856805.780011:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856806.801519:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787856807.075878:0:14039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:53:25 (1787856805) 00000100:00100000:3.0:1787856807.390666:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856807.390707:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856807.390771:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856807.390819:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856807.390851:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856807.390888:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426813696 00000100:00100000:3.0:1787856807.390902:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426813696 00000100:00100000:3.0:1787856807.391092:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 380 00000100:00100000:3.0:1787856807.391106:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426813696:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856807.391202:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426813696:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 100us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856807.391211:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 380 00000100:00100000:1.0:1787856807.397942:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426813824 00000100:00100000:1.0:1787856807.397960:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426813824 00000100:00100000:1.0:1787856807.404316:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426814080 00000100:00100000:1.0:1787856807.404335:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426814080 00000100:00100000:1.0:1787856807.404361:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426813952 00000100:00100000:1.0:1787856807.404365:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426813952 00000100:00100000:1.0:1787856807.404382:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426814208 00000100:00100000:1.0:1787856807.404404:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426814208 00000100:00100000:1.0:1787856807.404435:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 286 00000100:00100000:1.0:1787856807.404448:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426813824:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856807.405268:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426813824:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 818us (14615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856807.405279:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 286 00000100:00100000:1.0:1787856807.405309:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 287 00000100:00100000:1.0:1787856807.405318:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426814080:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856807.405353:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426814080:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 36us (14645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856807.405359:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 287 00000100:00100000:1.0:1787856807.405370:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 288 00000100:00100000:1.0:1787856807.405376:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426813952:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856807.405429:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426813952:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 52us (14609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856807.405436:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 288 00000100:00100000:1.0:1787856807.405450:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 289 00000100:00100000:1.0:1787856807.405458:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426814208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856807.405484:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426814208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (14632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856807.405490:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 289 00000100:00080000:1.0:1787856807.405542:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856807.405548:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787856807.825560:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856808.849459:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856808.994542:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856808.994682:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426814336 00000100:00100000:1.0:1787856808.994707:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426814336 00000100:00100000:1.0:1787856808.994790:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:1.0:1787856808.994800:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:11075:x1874703426814336:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856808.994828:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856808.994857:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3d44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f18 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856808.994944:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c3d4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856808.994972:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c3d4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856808.994989:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c3d4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856808.997759:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787856808.997772:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856808.998042:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c3d4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856808.998090:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3d44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f18 expref: 7 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856808.998115:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c3d4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f18 expref: 6 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856808.998124:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c3c5fe00) 00010000:00010000:1.0:1787856808.998128:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856808.998149:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938a00, rc 0) 00000100:00100000:1.0:1787856808.998371:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:11075:x1874703426814336:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3570us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856808.998383:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:2.0:1787856809.006738:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856809.007192:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426814464 00000100:00100000:1.0:1787856809.007205:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426814464 00000100:00100000:1.0:1787856809.007395:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:1.0:1787856809.007409:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0165e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:11076:x1874703426814464:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856809.007434:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856809.007460:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f1f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007536:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007553:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007565:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007579:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007587:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007593:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007656:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c3d67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007679:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c3d67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007701:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c3d67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856809.007745:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787856809.007749:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856809.007769:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c3d67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007780:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007798:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007805:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007811:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856809.007816:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007824:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007836:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c3c5fe00) 00010000:00010000:1.0:1787856809.007839:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856809.007845:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007871:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007896:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007903:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007909:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007915:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856809.007918:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007924:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007941:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9065c3c5f500) 00010000:00010000:1.0:1787856809.007945:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856809.007948:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007962:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.007995:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f1f expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.008009:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c3d67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f1f expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.008023:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9065c3c5fd00) 00010000:00010000:1.0:1787856809.008025:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856809.008028:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939e00, rc 0) 00000100:00100000:1.0:1787856809.008103:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0165e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:11076:x1874703426814464:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 696us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.008110:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00080000:2.0:1787856809.012097:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856809.013455:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856809.013615:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426814592 00000100:00100000:0.0:1787856809.013625:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426814592 00000100:00100000:0.0:1787856809.013684:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1787856809.013696:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:898e91b3-529b-44bc-a821-726bff6c71d4+7:11076:x1874703426814592:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787856809.013868:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:898e91b3-529b-44bc-a821-726bff6c71d4+7:11076:x1874703426814592:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 Request processed in 167us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856809.013877:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1787856809.018454:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856809.018599:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426814848 00000100:00100000:1.0:1787856809.018612:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426814848 00000100:00100000:1.0:1787856809.018737:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:1.0:1787856809.018749:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:11076:x1874703426814848:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856809.018771:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856809.018802:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3d6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f26 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.018898:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.018914:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.018926:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019008:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019017:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019046:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019168:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938c00/0xc25410d92a3c3d83 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019177:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938c00/0xc25410d92a3c3d83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019184:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938c00/0xc25410d92a3c3d83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856809.019194:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787856809.019326:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019335:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019342:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019348:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856809.019352:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019360:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019372:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9065c3c5fd00) 00010000:00010000:1.0:1787856809.019375:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856809.019387:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019393:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3d75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019409:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019416:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019422:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019425:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856809.019429:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019436:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019444:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9065c3c5f500) 00010000:00010000:1.0:1787856809.019446:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856809.019449:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019456:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c3d7c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019717:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3d6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f26 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019743:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938c00/0xc25410d92a3c3d83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f26 expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856809.019751:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:1.0:1787856809.019754:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856809.019756:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938c00, rc 0) 00000100:00100000:1.0:1787856809.019833:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+9:11076:x1874703426814848:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1086us (1392us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787856809.019842:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1787856809.028451:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856809.028587:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426814976 00000100:00100000:1.0:1787856809.028598:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426814976 00000100:00100000:1.0:1787856809.028720:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:1.0:1787856809.028732:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+9:11076:x1874703426814976:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787856809.028856:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+9:11076:x1874703426814976:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 126us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.028870:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1787856809.037037:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856809.037270:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426815104 00000100:00100000:1.0:1787856809.037281:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426815104 00000100:00100000:1.0:1787856809.037397:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:1.0:1787856809.037408:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:11076:x1874703426815104:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787856809.037538:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787856809.043926:0:8909:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6461us 00000100:00100000:0.0:1787856809.059265:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:11076:x1874703426815104:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 21849us (22228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856809.059280:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:1.0:1787856809.297442:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436347392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856809.297514:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856809.297588:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436347392 00000100:00100000:1.0:1787856809.297595:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436347392 00000100:00100000:0.0:1787856809.297833:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436347520:0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.297871:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856809.297897:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436348032:0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.297934:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856809.297964:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436348544:0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.297991:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856809.298022:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787856809.298029:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436347648:0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.298053:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856809.298071:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436348160:0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.298094:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856809.298110:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436348672:0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.298129:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856809.298159:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436348032 00000100:00100000:0.0:1787856809.298164:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436348032 00000100:00100000:0.0:1787856809.298205:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787856809.298215:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436348032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.298277:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436348544 00000100:00100000:0.0:1787856809.298280:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436348544 00000100:00100000:1.0:1787856809.298497:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787856809.298505:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436347392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856809.298531:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856809.298574:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436347392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.298581:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787856809.298603:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436347520 00000100:00100000:1.0:1787856809.298607:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436347520 00000100:00100000:1.0:1787856809.298867:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1787856809.298876:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436347520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.298916:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436347520:12345-0@lo:400:kworker.0 Request processed in 43us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.298933:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1787856809.298972:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436347648 00000100:00100000:1.0:1787856809.298976:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436347648 00000100:00100000:1.0:1787856809.299002:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436348672 00000100:00100000:1.0:1787856809.299068:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436348672 00000100:00100000:0.0:1787856809.302034:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787856809.302063:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436347648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.302163:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436347648:12345-0@lo:400:kworker.0 Request processed in 104us (4108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856809.302170:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787856809.302188:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787856809.302195:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436348544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.302241:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436348544:12345-0@lo:400:kworker.0 Request processed in 47us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856809.302247:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787856809.302294:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065c4a6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436349184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856809.302348:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856809.302379:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856809.302386:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d0167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436349056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856809.302407:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856809.302432:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436349184 00000100:00100000:0.0:1787856809.302440:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436349184 00000100:00100000:0.0:1787856809.302468:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436349056 00000100:00100000:0.0:1787856809.302471:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436349056 00000100:00100000:0.0:1787856809.302488:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787856809.302494:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436349184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856809.302518:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856809.302552:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436349184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856809.302558:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787856809.302570:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787856809.302576:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436349056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856809.302592:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856809.302617:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436349056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856809.302623:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787856809.304484:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d0167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436349056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856809.304507:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065c4a6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436349184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856809.304623:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436348032:12345-0@lo:400:kworker.0 Request processed in 6409us (6699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856809.304721:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787856809.305798:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787856809.305811:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436348672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.305867:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436348672:12345-0@lo:400:kworker.0 Request processed in 59us (7736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.305873:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787856809.305919:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436347648:0@lo:400:kworker.0 00010000:00080000:1.0:1787856809.305936:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c7beda40 x1874703436348672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856809.305945:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436348672:0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.305982:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436347520:0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.305993:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436348032:0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.306016:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436348544:0@lo:400:kworker.0 00000100:00080000:3.0:1787856809.309123:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856809.309137:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856809.309141:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856809.309144:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856809.309179:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436348160 00000100:00100000:3.0:1787856809.309189:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436348160 00000100:00100000:3.0:1787856809.309283:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787856809.309294:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436348160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.309388:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436348160:12345-0@lo:400:kworker.0 Request processed in 95us (11291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856809.309395:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787856809.309439:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436347776:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.309482:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856809.309531:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436348288:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.309561:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856809.309579:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436348800:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.309601:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856809.309621:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787856809.309884:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436348800 00000100:00100000:1.0:1787856809.309889:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436348800 00000100:00100000:1.0:1787856809.309919:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787856809.309927:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436348800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.309977:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436348800:12345-0@lo:400:kworker.0 Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.309983:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1787856809.310086:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787856809.310123:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a212c0 x1874703436348160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856809.310138:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436348160:0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.310184:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436347776 00000100:00100000:1.0:1787856809.310188:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436347776 00000100:00100000:1.0:1787856809.310212:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787856809.310247:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436347776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.310284:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436347776:12345-0@lo:400:kworker.0 Request processed in 40us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.310290:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787856809.310314:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436348288 00000100:00100000:1.0:1787856809.310317:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436348288 00000100:00100000:1.0:1787856809.310346:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787856809.310352:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436348288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.310390:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436348288:12345-0@lo:400:kworker.0 Request processed in 38us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.310397:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1787856809.310410:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856809.311886:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436347904:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.311964:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856809.312000:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436348416:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.312106:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856809.312137:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436348928:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.312162:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856809.312204:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436347776:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.312242:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436348288:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.312255:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436348800:0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.312302:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436348928 00000100:00100000:3.0:1787856809.312307:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436348928 00000100:00100000:3.0:1787856809.312352:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787856809.312362:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436348928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856809.312411:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436348928:12345-0@lo:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856809.312418:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787856809.312447:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436348928:0@lo:400:kworker.0 00010000:00080000:3.0:1787856809.312487:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90660193f840 x1874703436347392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856809.312525:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436347392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856809.313613:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436347904 00000100:00100000:2.0:1787856809.313623:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436347904 00000100:00100000:2.0:1787856809.313680:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436348416 00000100:00100000:2.0:1787856809.313683:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436348416 00000100:00100000:2.0:1787856809.313719:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787856809.313727:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436347904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856809.313938:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787856809.313949:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436348416:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787856809.314800:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856809.318156:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436348416:12345-0@lo:400:kworker.0 Request processed in 4198us (6037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856809.318173:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787856809.318315:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436347904:12345-0@lo:400:kworker.0 Request processed in 4586us (6359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856809.318324:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00010000:00080000:1.0:1787856809.318513:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c6b5c000 x1874703436348416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856809.318529:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436348416:0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.318558:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436347904:0@lo:400:kworker.0 00000100:00100000:1.0:1787856809.809567:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d0167840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436349312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856809.809672:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856809.809801:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436349312 00000100:00100000:1.0:1787856809.809811:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436349312 00000100:00100000:1.0:1787856809.809874:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787856809.809885:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436349312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856809.809915:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856809.809988:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436349312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856809.809996:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:1.0:1787856809.810045:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d0167840 x1874703436349312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856809.810065:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d0167840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436349312:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787856809.810896:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787856809.812758:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787856809.873560:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856810.322519:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436349440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856810.322624:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856810.322886:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436349440 00000100:00100000:1.0:1787856810.322898:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436349440 00000100:00100000:1.0:1787856810.322980:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787856810.323003:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436349440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856810.323050:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787856810.323115:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436349440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856810.323124:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787856810.323176:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436349440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856810.835487:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856810.835520:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436349568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856810.835621:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856810.835712:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436349568 00000100:00100000:1.0:1787856810.835722:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436349568 00000100:00100000:1.0:1787856810.835785:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787856810.835796:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436349568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856810.835843:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787856810.835897:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436349568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856810.835905:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787856810.835994:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436349568:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856810.898136:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856811.648385:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856811.652585:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426815232 00000100:00100000:2.0:1787856811.652600:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426815232 00000100:00080000:1.0:1787856811.652656:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856811.652701:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1787856811.652715:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+9:11119:x1874703426815232:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856811.652735:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856811.652761:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3d91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f2d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652828:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652842:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652855:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652871:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652879:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652886:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652952:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652961:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652967:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652974:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856811.652979:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.652987:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653000:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c3c5fe00) 00010000:00010000:2.0:1787856811.653003:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856811.653008:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653014:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653027:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653032:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653039:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653051:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856811.653054:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653060:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653068:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9064c793d500) 00010000:00010000:2.0:1787856811.653070:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856811.653073:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653079:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3d9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653115:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3d91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f2d expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653125:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c3c5fe00) 00010000:00010000:2.0:1787856811.653127:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856811.653130:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3d91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f2d expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.653139:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b600, rc 0) 00000100:00100000:2.0:1787856811.653211:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+9:11119:x1874703426815232:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 499us (4841us total) trans 0 rc 301/301 00000100:00100000:2.0:1787856811.653272:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1787856811.661611:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856811.661899:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426815488 00000100:00100000:3.0:1787856811.661916:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426815488 00000100:00100000:3.0:1787856811.662070:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1787856811.662083:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0165a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+9:11119:x1874703426815488:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:3.0:1787856811.662161:0:8909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856811.662196:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c3d4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f18 expref: 9 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.662214:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c3c5fe00) 00010000:00010000:3.0:1787856811.662247:0:8909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856811.662334:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.662350:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.662361:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.662375:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.662382:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.662402:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663498:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663515:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663525:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787856811.663600:0:8909:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fdf6b7f reply state 00000000d9278644 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663613:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663621:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:3.0:1787856811.663623:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787856811.663627:0:8909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787856811.663632:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787856811.663640:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663647:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663654:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663660:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856811.663678:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663687:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663874:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c46a7800) 00010000:00010000:3.0:1787856811.663878:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856811.663882:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663890:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3da6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787856811.663914:0:8909:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fdf6b7f reply state 00000000d9278644 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663924:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.663938:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9065c46a7c00) 00010000:00010000:3.0:1787856811.663941:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787856811.663943:0:8909:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787856811.664159:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0165a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+10:11119:x1874703426815488:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 2073us (2554us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787856811.664169:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:1.0:1787856811.808736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856811.808982:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426815616 00000100:00100000:0.0:1787856811.808997:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426815616 00000100:00100000:0.0:1787856811.809569:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:0.0:1787856811.809584:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+10:11127:x1874703426815616:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:0.0:1787856811.809619:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856811.809649:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c3dbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f34 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.809739:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c3dc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.809780:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c3dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.809795:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c3dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856811.809861:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787856811.809877:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856811.809943:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c3dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.809976:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c3dbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f34 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.809999:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c3dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f34 expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.810009:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:0.0:1787856811.810013:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787856811.810017:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb000, rc 0) 00000100:00100000:0.0:1787856811.810108:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+11:11127:x1874703426815616:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 528us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856811.810116:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:1.0:1787856811.867110:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856811.867301:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426815744 00000100:00100000:2.0:1787856811.867315:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426815744 00000100:00100000:2.0:1787856811.867398:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1787856811.867411:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+11:11133:x1874703426815744:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856811.867441:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856811.867469:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3dc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f3b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.867742:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.867841:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.867856:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.867872:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.867880:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.867887:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868016:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c3dde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868025:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c3dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868056:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c3dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856811.868114:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787856811.868119:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856811.868355:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c3dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868371:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868377:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868384:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868389:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856811.868394:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868401:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868415:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:2.0:1787856811.868418:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856811.868424:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868430:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868457:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868463:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868469:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868473:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856811.868476:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868483:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868491:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9065c46a7c00) 00010000:00010000:2.0:1787856811.868493:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856811.868496:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868501:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3dd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868605:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3dc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f3b expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868624:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c3dde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f3b expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856811.868646:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856811.868648:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787856811.868651:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b400, rc 0) 00000100:00100000:2.0:1787856811.868889:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+12:11133:x1874703426815744:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1480us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856811.868899:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1787856811.872450:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856811.872520:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426816000 00000100:00100000:0.0:1787856811.872602:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426816000 00000100:00100000:0.0:1787856811.872693:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:0.0:1787856811.872706:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+12:11133:x1874703426816000:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856811.872734:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856811.872776:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c3de5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f42 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.872940:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.872961:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.872974:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.874914:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.874951:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.874964:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787856811.875801:0:9124:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787856811.876125:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.876137:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.876145:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.876181:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.876207:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884173:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884203:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856811.884210:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884235:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884257:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:0.0:1787856811.884259:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856811.884265:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884272:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3dec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856811.884296:0:9124:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000849bc38c reply state 0000000005ab6cbe transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884310:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884318:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79500) 00010000:00010000:0.0:1787856811.884320:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856811.884324:0:9124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787856811.884395:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c3de5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 15 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884434:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 14 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.884442:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c5b79100) 00010000:00010000:0.0:1787856811.884444:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856811.884446:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba400, rc 0) 00000100:00100000:0.0:1787856811.884533:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+15:11133:x1874703426816000:12345-192.168.202.6@tcp:101:bash.0 Request processed in 11829us (12094us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787856811.884542:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:1.0:1787856811.889698:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856811.890259:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426816128 00000100:00100000:2.0:1787856811.890274:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426816128 00000100:00100000:2.0:1787856811.890330:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:2.0:1787856811.890340:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874703426816128:12345-192.168.202.6@tcp:8:bash.0 00010000:00080000:2.0:1787856811.890379:0:8409:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp t0 exp 0000000000000000 cur 345 last 0 00000020:00000080:2.0:1787856811.890409:0:8409:0:(genops.c:1385:class_connect()) connect: client 898e91b3-529b-44bc-a821-726bff6c71d4, cookie 0xc25410d92a3c3e08 00002000:00100000:2.0:1787856811.890421:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 898e91b3-529b-44bc-a821-726bff6c71d4/ffff9064c8399000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787856811.890439:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:2.0:1787856811.890515:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787856811.890563:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9064c839b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856811.890637:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2398:x1874703426816128:12345-192.168.202.6@tcp:8:bash.0 Request processed in 298us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856811.890645:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:1.0:1787856811.893887:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856811.894466:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426816256 00000100:00100000:3.0:1787856811.894480:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426816256 00000100:00100000:3.0:1787856811.894610:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1787856811.894628:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:0:x1874703426816256:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1787856811.894671:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856811.894702:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f49 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856811.894735:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856811.894760:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1787856811.894766:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856811.894778:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.894806:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.894824:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8000, rc 0) 00000100:00100000:3.0:1787856811.895078:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:0:x1874703426816256:12345-192.168.202.6@tcp:101:bash.0 Request processed in 456us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856811.895089:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1787856811.898390:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856811.898533:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426816384 00000100:00100000:0.0:1787856811.898549:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426816384 00000100:00100000:0.0:1787856811.898636:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1787856811.898647:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:11133:x1874703426816384:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856811.898665:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856811.898686:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f50 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.898718:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.898728:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856811.898734:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856811.898740:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.898794:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.898809:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 8 pid: 8410 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856811.898840:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a96d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1874703436349696:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856811.899136:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c714c180 going to sleep for 11 seconds 00000100:00080000:1.0:1787856811.901436:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856811.903335:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a96d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1874703436349696:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856811.903360:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1787856811.903384:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856811.903409:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007baa00, rc 0) 00000100:00100000:3.0:1787856811.903687:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426816512 00000100:00100000:3.0:1787856811.903699:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426816512 00010000:00010000:3.0:1787856811.903811:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 9 pid: 8410 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856811.903916:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:3.0:1787856811.903938:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+9:2402:x1874703426816512:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856811.903960:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856811.904020:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 9 pid: 8410 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.904037:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 9 pid: 8410 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.904066:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f49 expref: 9 pid: 8410 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.904088:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856811.904094:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856811.904104:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.904115:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856811.904172:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856811.904190:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065c4a6cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6483:1874703436349824:192.168.202.6@tcp:105: 00000100:00100000:3.0:1787856811.904358:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856811.908347:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065c4a6cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6483:1874703436349824:192.168.202.6@tcp:105: 00010000:00010000:0.0:1787856811.908381:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856811.909474:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426816512:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 5532us (6110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856811.909493:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:1.0:1787856811.910040:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:11133:x1874703426816384:12345-192.168.202.6@tcp:101:bash.0 Request processed in 11385us (11660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856811.910071:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1787856811.915103:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856811.915310:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426816768 00000100:00100000:2.0:1787856811.915326:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426816768 00000100:00100000:2.0:1787856811.915435:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:2.0:1787856811.915446:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+15:11133:x1874703426816768:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1787856811.915924:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+16:11133:x1874703426816768:12345-192.168.202.6@tcp:35:bash.0 Request processed in 477us (833us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787856811.915943:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00010000:00010000:3.0:1787856811.921425:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856812.062650:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.063429:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426817024 00000100:00100000:0.0:1787856812.063445:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426817024 00000100:00100000:0.0:1787856812.063538:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:0.0:1787856812.063551:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+16:11143:x1874703426817024:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856812.063589:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856812.063617:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f57 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856812.063787:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787856812.063950:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3e1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f57 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.063968:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:0.0:1787856812.063972:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787856812.063978:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f57 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.063995:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba000, rc 0) 00000100:00100000:0.0:1787856812.064552:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+17:11143:x1874703426817024:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1001us (1913us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787856812.064562:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:3.0:1787856812.069264:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.069441:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426817280 00000100:00100000:0.0:1787856812.069457:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426817280 00000100:00100000:0.0:1787856812.069548:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1787856812.069561:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+17:11143:x1874703426817280:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1787856812.069882:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+18:11143:x1874703426817280:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 322us (682us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787856812.069891:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1787856812.164808:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856812.164962:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426817408 00000100:00100000:2.0:1787856812.164976:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426817408 00000100:00100000:2.0:1787856812.165059:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:2.0:1787856812.165073:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:11149:x1874703426817408:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856812.165111:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856812.165139:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3e2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f5e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.165304:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3e32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.165325:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.165341:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856812.165402:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787856812.165408:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856812.165440:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.165477:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f5e expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.165528:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3e32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f5e expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.165540:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856812.165544:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856812.165548:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a200, rc 0) 00000100:00100000:2.0:1787856812.165638:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+19:11149:x1874703426817408:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 568us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856812.165647:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1787856812.176069:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.176195:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426817664 00000100:00100000:0.0:1787856812.176209:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426817664 00000100:00100000:0.0:1787856812.176325:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:0.0:1787856812.176336:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+19:11149:x1874703426817664:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856812.176364:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856812.176413:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3e39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f65 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.176583:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.176602:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.176615:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856812.176629:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787856812.177019:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3e39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f65 expref: 22 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.177042:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f65 expref: 21 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.177053:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c5b79100) 00010000:00010000:0.0:1787856812.177057:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856812.177061:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbc00, rc 0) 00000100:00100000:0.0:1787856812.177153:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+21:11149:x1874703426817664:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 818us (1098us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787856812.177161:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:3.0:1787856812.180700:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.180810:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426817920 00000100:00100000:0.0:1787856812.180824:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426817920 00000100:00100000:0.0:1787856812.180921:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:0.0:1787856812.180941:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601999680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+21:11149:x1874703426817920:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856812.180998:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856812.181029:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c3e4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f6c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.181179:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3e55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.181197:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3e55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.181212:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3e55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856812.181261:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787856812.181403:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c3e4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f6c expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.181425:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3e55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f6c expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.181434:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c5b79100) 00010000:00010000:0.0:1787856812.181438:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787856812.181441:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba800, rc 0) 00000100:00100000:0.0:1787856812.181534:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601999680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+23:11149:x1874703426817920:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 595us (848us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787856812.181543:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:1.0:1787856812.188025:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856812.188080:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.188180:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426818048 00000100:00100000:0.0:1787856812.188196:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426818048 00000100:00100000:0.0:1787856812.188314:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:0.0:1787856812.188347:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+23:2401:x1874703426818048:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856812.188371:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856812.188407:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f65 expref: 23 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.188433:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c5b79100) 00010000:00010000:0.0:1787856812.188439:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856812.188517:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+22:2401:x1874703426818048:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 174us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856812.188525:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:3.0:1787856812.188949:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426818176 00000100:00100000:3.0:1787856812.188956:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426818176 00000100:00100000:3.0:1787856812.189009:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:3.0:1787856812.189018:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426818176:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:3.0:1787856812.189063:0:10490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.189086:0:10490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.189096:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856812.189101:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787856812.189106:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.189146:0:10490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.189162:0:10490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 7 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856812.189179:0:10490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660199a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10490:1874703436349952:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856812.189311:0:10490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856812.193949:0:10490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660199a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10490:1874703436349952:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856812.194031:0:10490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856812.198095:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856812.198355:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426818304 00000100:00100000:1.0:1787856812.198495:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426818304 00002000:00100000:1.0:1787856812.198555:0:8413:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9065d0164b40 x1874703426818304/t0(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:213/0 lens 504/0 e 0 to 0 dl 1787856823 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787856812.198566:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9065d0164b40 with x1874703426818304 ext(0->12) 00010000:00010000:1.0:1787856812.198576:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 8 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.198594:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 8 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787856812.198604:0:8413:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9065d0164b40 00000100:00100000:1.0:1787856812.198704:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:1.0:1787856812.198716:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0164b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426818304:12345-192.168.202.6@tcp:4:lfs.0 00000001:00100000:1.0:1787856812.207294:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000100:00100000:3.0:1787856812.208799:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0164b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+9:2402:x1874703426818304:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 10068us (10696us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787856812.208826:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00002000:00100000:3.0:1787856812.208858:0:8413:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9065d0164b40 x1874703426818304/t4294967300(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:213/0 lens 504/448 e 0 to 0 dl 1787856823 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856812.208871:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9065d0164b40 with x1874703426818304 ext(0->12) 00010000:00010000:3.0:1787856812.208885:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 9 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.208909:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 9 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856812.208919:0:8413:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9065d0164b40 00000100:00100000:1.0:1787856812.213873:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856812.214130:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426818432 00000100:00100000:3.0:1787856812.214140:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426818432 00010000:00010000:3.0:1787856812.214185:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 9 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856812.214269:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1787856812.214280:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+9:2399:x1874703426818432:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856812.214296:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787856812.214313:0:13165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787856812.214329:0:13165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787856811 00002000:00010000:3.0:1787856812.214332:0:13165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787856812 00002000:00010000:3.0:1787856812.214335:0:13165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787856811 00002000:00010000:3.0:1787856812.214337:0:13165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787856812.214344:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 9 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.214358:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 9 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.214384:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c3e16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f50 expref: 9 pid: 8407 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.214403:0:13165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787856812.214407:0:13165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787856812.214413:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.214423:0:13165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.214450:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856812.214510:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+8:2399:x1874703426818432:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 233us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856812.214518:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00010000:00010000:1.0:1787856812.214649:0:10490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.214658:0:10490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.214691:0:10490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.214710:0:10490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.214718:0:10490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.214726:0:10490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856812.214731:0:10490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.214740:0:10490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.214756:0:10490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.214765:0:10490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b899b46/0xc25410d92a3c3e63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856812.214812:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426818176:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 25796us (26730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856812.214821:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:2.0:1787856812.223855:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.223989:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426818688 00000100:00100000:0.0:1787856812.224001:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426818688 00000100:00100000:0.0:1787856812.224065:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:0.0:1787856812.224076:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0166d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:11149:x1874703426818688:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:0.0:1787856812.224141:0:6499:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3e55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f6c expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787856812.224398:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1787856812.224444:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787856812.224720:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1787856812.224756:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.224773:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 26 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.224782:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.224829:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 26 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.224844:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 26 pid: 9124 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856812.224859:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1874703436350080:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856812.224948:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c714cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856812.234680:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856812.234800:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426818816 00000100:00100000:3.0:1787856812.234809:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426818816 00010000:00010000:3.0:1787856812.234852:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 27 pid: 9124 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856812.234902:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:3.0:1787856812.234916:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+27:2401:x1874703426818816:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856812.234940:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856812.234947:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 27 pid: 9124 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.234960:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 27 pid: 9124 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.234983:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c5b79100) 00010000:00010000:3.0:1787856812.234988:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.234997:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.235005:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.235022:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856812.235077:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+27:2401:x1874703426818816:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 162us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856812.235084:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00010000:00010000:0.0:1787856812.236186:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c3dfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f42 expref: 26 pid: 9124 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856812.236208:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1874703436350080:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856812.236284:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.236295:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.236301:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787856812.236408:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1787856812.236511:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1787856812.236597:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436350208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787856812.236662:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856812.236685:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c714c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856812.236897:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436350208 00000100:00100000:1.0:1787856812.236902:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436350208 00000100:00100000:1.0:1787856812.236976:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787856812.236987:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436350208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787856812.237057:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436350208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856812.237064:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1787856812.237125:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856812.237421:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436350208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787856812.237563:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1787856812.237606:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436350336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787856812.237849:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856812.237867:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c714c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856812.237938:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436350336 00000100:00100000:1.0:1787856812.237944:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436350336 00000100:00100000:1.0:1787856812.237980:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787856812.237987:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436350336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787856812.238092:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6499:x1874703436350336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (242us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787856812.238098:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787856812.238381:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436350336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787856812.238421:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1787856812.238453:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.238464:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.238472:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.238477:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856812.238482:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.238489:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.238506:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c5b79100) 00010000:00010000:0.0:1787856812.238509:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787856812.238513:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.238518:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c3e6a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787856812.238602:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787856812.239800:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787856812.239816:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345949597731ns, next at 346949594651ns, rc = 0 00000001:00080000:0.0:1787856812.239829:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1787856812.239870:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c5b79100) 00010000:00010000:0.0:1787856812.239874:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787856812.239883:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3e55 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f6c expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856812.240044:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0166d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+29:11149:x1874703426818688:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 15968us (16198us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787856812.240054:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000020:00080000:0.0:1787856812.240060:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787856812.243383:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856812.243485:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426818944 00000100:00100000:1.0:1787856812.243495:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426818944 00000100:00100000:1.0:1787856812.243589:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:1.0:1787856812.243599:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0166580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+29:11149:x1874703426818944:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856812.243622:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856812.243653:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c3e71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f73 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.243717:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c3e71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f73 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.243732:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c3e71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f73 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.243770:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:1.0:1787856812.243774:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856812.243777:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939c00, rc 0) 00000100:00100000:1.0:1787856812.243833:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0166580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+30:11149:x1874703426818944:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 235us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856812.243840:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:2.0:1787856812.250182:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856812.250305:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426819200 00000100:00100000:3.0:1787856812.250316:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426819200 00000100:00100000:3.0:1787856812.250386:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1787856812.250412:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0394c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+30:11149:x1874703426819200:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856812.250665:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0394c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+31:11149:x1874703426819200:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 255us (494us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787856812.250674:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:2.0:1787856812.340795:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856812.340872:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426819456 00000100:00100000:3.0:1787856812.340882:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426819456 00000100:00100000:3.0:1787856812.340961:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:3.0:1787856812.340984:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0164780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+31:11159:x1874703426819456:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1787856812.341010:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856812.341028:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f7a expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856812.341126:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787856812.341256:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3e78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f7a expref: 33 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.341270:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:3.0:1787856812.341273:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856812.341278:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f7a expref: 33 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.341293:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9000, rc 0) 00000100:00100000:3.0:1787856812.341354:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0164780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+32:11159:x1874703426819456:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 383us (566us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1787856812.341362:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:2.0:1787856812.343587:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856812.343688:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426819584 00000100:00100000:1.0:1787856812.343697:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426819584 00000100:00100000:1.0:1787856812.343754:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:1.0:1787856812.343764:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0166940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+32:11159:x1874703426819584:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:1.0:1787856812.343836:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.343852:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.343866:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.343878:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.343885:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.343891:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.343999:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344023:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344032:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787856812.344090:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344103:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344111:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344117:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344124:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856812.344128:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344136:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344148:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856812.344151:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856812.344155:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344162:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3e86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344182:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344189:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344195:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344200:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856812.344203:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344209:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344255:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79500) 00010000:00010000:1.0:1787856812.344259:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856812.344262:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344268:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3e8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344278:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344284:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344290:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344302:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856812.344305:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344310:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344318:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:1.0:1787856812.344320:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856812.344323:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.344328:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856812.344390:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0166940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+32:11159:x1874703426819584:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 626us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856812.344398:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:2.0:1787856812.346465:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856812.346571:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426819840 00000100:00100000:3.0:1787856812.346592:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426819840 00000100:00100000:3.0:1787856812.346656:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1787856812.346666:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+32:11159:x1874703426819840:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856812.346889:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+33:11159:x1874703426819840:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 224us (430us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787856812.346897:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:2.0:1787856812.389861:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856812.390128:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426820096 00000100:00100000:1.0:1787856812.390139:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426820096 00000100:00100000:1.0:1787856812.390213:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1787856812.390271:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0165680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+33:11162:x1874703426820096:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856812.390299:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856812.390322:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f81 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390417:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390449:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390462:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390474:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390482:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390489:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390595:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390604:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390611:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856812.390621:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787856812.390891:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390900:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390907:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390920:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856812.390949:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.390958:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391120:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856812.391124:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856812.391130:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391136:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c3ea2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391150:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391155:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391162:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391167:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856812.391170:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391177:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391196:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79500) 00010000:00010000:1.0:1787856812.391199:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856812.391202:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391208:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c3ea9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391296:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c3e9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391310:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.391317:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:1.0:1787856812.391320:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856812.391322:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939000, rc 0) 00000100:00100000:1.0:1787856812.391790:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0165680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+35:11162:x1874703426820096:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1520us (1936us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787856812.391799:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:0.0:1787856812.397207:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856812.397495:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426820224 00000100:00100000:2.0:1787856812.397504:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426820224 00000100:00100000:2.0:1787856812.397557:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1787856812.397566:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+35:11162:x1874703426820224:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1787856812.397628:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397708:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397733:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397765:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397772:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397779:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397784:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856812.397789:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397797:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397806:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856812.397809:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787856812.397814:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856812.397820:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3ebe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856812.397984:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+35:11162:x1874703426820224:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 418us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856812.397999:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1787856812.408390:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856812.408654:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426820480 00000100:00100000:3.0:1787856812.408664:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426820480 00000100:00100000:3.0:1787856812.408727:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:3.0:1787856812.408737:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+35:11162:x1874703426820480:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787856812.409565:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+36:11162:x1874703426820480:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 826us (1183us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787856812.409575:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1787856812.513444:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856812.513477:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856812.513501:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856812.513515:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856812.513531:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.513591:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426821120 00000100:00100000:0.0:1787856812.513599:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426821120 00000100:00100000:0.0:1787856812.513656:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426820736 00000100:00100000:0.0:1787856812.513660:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426820736 00000100:00100000:0.0:1787856812.513681:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426820992 00000100:00100000:0.0:1787856812.513684:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426820992 00000100:00100000:0.0:1787856812.513703:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 296 00000100:00100000:0.0:1787856812.513710:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426821120:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856812.513772:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426821120:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856812.513778:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 296 00000100:00100000:0.0:1787856812.513791:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 297 00000100:00100000:0.0:1787856812.513795:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0167840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426820736:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856812.513811:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0167840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2401:x1874703426820736:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 15us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856812.513831:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 297 00000100:00100000:0.0:1787856812.513844:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 298 00000100:00100000:0.0:1787856812.513850:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0167c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426820992:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856812.513877:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0167c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426820992:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856812.513883:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 298 00000100:00100000:3.0:1787856812.514205:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426820864 00000100:00100000:3.0:1787856812.514210:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426820864 00000100:00100000:3.0:1787856812.514279:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:3.0:1787856812.514286:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426820864:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856812.514319:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426820864:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 34us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856812.514326:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:1.0:1787856812.514595:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426820608 00000100:00100000:1.0:1787856812.514601:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426820608 00000100:00100000:1.0:1787856812.514639:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 382 00000100:00100000:1.0:1787856812.514647:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426820608:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856812.514676:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2401:x1874703426820608:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856812.514682:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 382 00000100:00080000:2.0:1787856812.514992:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856812.514997:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856812.737937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.738411:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426821376 00000100:00100000:0.0:1787856812.738422:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426821376 00000100:00100000:0.0:1787856812.738521:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:0.0:1787856812.738532:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+36:11193:x1874703426821376:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1787856812.738556:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856812.738577:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3ec5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f88 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.738696:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c3ecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.738710:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c3ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.738722:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c3ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856812.738732:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787856812.738852:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c3ec5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f88 expref: 39 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.738893:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c3ecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f88 expref: 38 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.738914:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856812.738917:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856812.738932:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb400, rc 0) 00000100:00100000:0.0:1787856812.739608:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+38:11193:x1874703426821376:12345-192.168.202.6@tcp:101:cat.0 Request processed in 1075us (1704us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787856812.739617:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:0.0:1787856812.744372:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.744529:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856812.744732:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426821760 00000100:00100000:2.0:1787856812.744742:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426821760 00000100:00100000:2.0:1787856812.744805:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:2.0:1787856812.744815:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+38:11193:x1874703426821760:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:2.0:1787856812.745140:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+39:11193:x1874703426821760:12345-192.168.202.6@tcp:35:cat.0 Request processed in 319us (603us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1787856812.745149:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1787856812.746521:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426821504 00000100:00100000:3.0:1787856812.746531:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426821504 00000100:00100000:3.0:1787856812.746648:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:3.0:1787856812.746658:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+39:2402:x1874703426821504:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856812.746673:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856812.746697:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c3ecc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f88 expref: 39 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.746713:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856812.746731:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856812.746792:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+38:2402:x1874703426821504:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 136us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856812.746799:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1787856812.821665:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856812.821834:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426822016 00000100:00100000:3.0:1787856812.821847:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426822016 00000100:00100000:3.0:1787856812.821952:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1787856812.821966:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+38:11199:x1874703426822016:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1787856812.822001:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856812.822006:0:8909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787856812.822043:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3e32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f5e expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.822067:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:3.0:1787856812.822073:0:8909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856812.822091:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3eda lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f8f expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.822296:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.822312:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.822322:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.822365:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.822405:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 38 pid: 6496 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856812.822422:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660199a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436350464:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856812.822559:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856812.828082:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856812.828679:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660199a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436350464:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856812.828738:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856812.828854:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426822144 00000100:00100000:1.0:1787856812.828866:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426822144 00010000:00010000:1.0:1787856812.828933:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 39 pid: 6496 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856812.828982:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:1.0:1787856812.828993:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+39:2402:x1874703426822144:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856812.829010:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856812.829017:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 39 pid: 6496 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.829030:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 39 pid: 6496 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.829057:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c3eb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f81 expref: 39 pid: 6496 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.829074:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:1.0:1787856812.829079:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.829089:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.829097:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.829123:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856812.829194:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+38:2402:x1874703426822144:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 202us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856812.829251:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00010000:00010000:3.0:1787856812.829521:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.829529:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856812.829554:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787856812.829800:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3eda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 39 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.829823:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 38 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856812.829834:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856812.829837:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787856812.829840:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8e00, rc 0) 00000100:00100000:3.0:1787856812.829896:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+38:11199:x1874703426822016:12345-192.168.202.6@tcp:101:dd.0 Request processed in 7935us (8248us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787856812.829944:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1787856812.836492:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856812.836589:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426822272 00000100:00100000:1.0:1787856812.836604:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426822272 00000100:00100000:1.0:1787856812.836686:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1787856812.836698:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+38:11199:x1874703426822272:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1787856812.836738:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856812.836765:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3eef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f96 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.836806:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.836825:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.836838:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.837009:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c3eef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.837028:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 39 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856812.837038:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:1.0:1787856812.837041:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787856812.837045:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939800, rc 0) 00000100:00100000:1.0:1787856812.837117:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+39:11199:x1874703426822272:12345-192.168.202.6@tcp:101:dd.0 Request processed in 422us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856812.837132:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1787856812.840465:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856812.840568:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426822528 00000100:00100000:0.0:1787856812.840581:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426822528 00000100:00100000:0.0:1787856812.840664:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1787856812.840684:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+39:11199:x1874703426822528:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:0.0:1787856812.841093:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.841118:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.841133:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787856812.841385:0:9124:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1787856812.841415:0:9124:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055c2000b reply state 00000000b2936c83 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.841431:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856812.841441:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856812.841444:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856812.841450:0:9124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856812.841591:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+42:11199:x1874703426822528:12345-192.168.202.6@tcp:36:dd.0 Request processed in 913us (1137us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787856812.841600:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000020:00080000:0.0:1787856812.841607:0:9124:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1787856812.882017:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787856812.885634:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787856812.945596:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856813.139940:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856813.140097:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426822656 00000100:00100000:3.0:1787856813.140112:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426822656 00000100:00100000:3.0:1787856813.140273:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:3.0:1787856813.140291:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+42:11213:x1874703426822656:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:3.0:1787856813.140324:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856813.140350:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3f04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5f9d expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140440:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140459:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140473:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140486:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140493:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140500:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140597:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140631:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 43 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140641:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140682:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 43 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.140699:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 43 pid: 8909 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856813.140716:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660199a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436350592:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856813.140847:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a9c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787856813.140959:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856813.143316:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.143427:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426822912 00000100:00100000:2.0:1787856813.143438:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426822912 00000100:00100000:2.0:1787856813.143502:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1787856813.143513:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+44:6172:x1874703426822912:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787856813.143959:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+45:6172:x1874703426822912:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 446us (657us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787856813.143968:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1787856813.144773:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660199a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436350592:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856813.144821:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856813.148637:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856813.148774:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426823040 00000100:00100000:3.0:1787856813.148786:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426823040 00010000:00010000:3.0:1787856813.148846:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 45 pid: 8909 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856813.148897:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:3.0:1787856813.148909:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+45:2401:x1874703426823040:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856813.148936:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856813.148962:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 45 pid: 8909 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.148977:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 45 pid: 8909 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.149006:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c3ee1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f8f expref: 45 pid: 8909 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.149028:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856813.149034:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.149046:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.149054:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.149098:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856813.149173:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+44:2401:x1874703426823040:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 266us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856813.149182:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00010000:00010000:0.0:1787856813.149782:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.149793:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856813.149865:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787856813.149870:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856813.149932:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.149949:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.149978:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.149984:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.149992:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.149999:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856813.150004:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150015:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150030:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:0.0:1787856813.150032:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856813.150037:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150043:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c3f0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150056:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150062:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150068:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150080:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856813.150083:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150089:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150098:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79500) 00010000:00010000:0.0:1787856813.150101:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856813.150104:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150110:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c3f12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150152:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c3f04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f9d expref: 44 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150171:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f9d expref: 43 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.150179:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856813.150182:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856813.150185:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fee00, rc 0) 00000100:00100000:0.0:1787856813.150290:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+43:11213:x1874703426822656:12345-192.168.202.6@tcp:101:stat.0 Request processed in 10006us (10371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856813.150301:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1787856813.253027:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.253449:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426823296 00000100:00100000:2.0:1787856813.253469:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426823296 00000100:00100000:2.0:1787856813.253546:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1787856813.253559:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+43:11219:x1874703426823296:12345-192.168.202.6@tcp:36:truncate.0 00010000:00010000:2.0:1787856813.253644:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856813.253694:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c3f19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f9d expref: 43 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.253722:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856813.253729:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856813.253985:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.254006:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.254019:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856813.254072:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1787856813.254099:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c140f13b reply state 00000000ba8b45b6 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.254114:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.254121:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856813.254124:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787856813.254127:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856813.254372:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+45:11219:x1874703426823296:12345-192.168.202.6@tcp:36:truncate.0 Request processed in 814us (1360us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787856813.254398:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000020:00080000:2.0:1787856813.254404:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787856813.457985:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856813.458159:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426823424 00000100:00100000:0.0:1787856813.458173:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426823424 00000100:00100000:0.0:1787856813.458296:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:0.0:1787856813.458308:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+45:11233:x1874703426823424:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:0.0:1787856813.458343:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856813.458371:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c3f27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fa4 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458459:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458478:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458493:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458507:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458514:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458520:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458616:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458627:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458655:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856813.458710:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787856813.458716:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856813.458739:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458754:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458763:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458770:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458778:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458785:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bac00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856813.458790:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458798:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458810:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:0.0:1787856813.458814:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856813.458819:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458839:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c3f2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458857:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458863:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458870:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458875:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856813.458878:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458884:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458892:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79500) 00010000:00010000:0.0:1787856813.458908:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856813.458911:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458926:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c3f35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458956:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c3f27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 47 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458969:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 46 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856813.458983:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856813.458985:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856813.458988:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbe00, rc 0) 00000100:00100000:0.0:1787856813.459081:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+46:11233:x1874703426823424:12345-192.168.202.6@tcp:101:stat.0 Request processed in 774us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856813.459089:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:0.0:1787856813.596063:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856813.596259:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426823680 00000100:00100000:3.0:1787856813.596272:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426823680 00000100:00100000:3.0:1787856813.596359:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:3.0:1787856813.596372:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+46:11243:x1874703426823680:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1787856813.596399:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856813.596424:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3f43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fab expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856813.596572:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787856813.596719:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3f43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fab expref: 48 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.596737:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:3.0:1787856813.596741:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856813.596747:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3f43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fab expref: 48 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.596764:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff200, rc 0) 00000100:00100000:3.0:1787856813.596848:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+47:11243:x1874703426823680:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 478us (800us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1787856813.596857:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1787856813.608083:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856813.608212:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426823936 00000100:00100000:0.0:1787856813.608276:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426823936 00000100:00100000:0.0:1787856813.608357:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1787856813.608369:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+47:11243:x1874703426823936:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1787856813.608687:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+48:11243:x1874703426823936:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 319us (618us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787856813.608695:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1787856813.766883:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.767020:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426824192 00000100:00100000:2.0:1787856813.767034:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426824192 00000100:00100000:2.0:1787856813.767127:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1787856813.767139:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+48:11249:x1874703426824192:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856813.767172:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856813.767199:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fb2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.767406:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.767425:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 49 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.767437:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.767518:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 49 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.767536:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 49 pid: 9124 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856813.767554:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436350720:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856813.767692:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ea180 going to sleep for 11 seconds 00000100:00100000:1.0:1787856813.777774:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.777892:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436350720:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856813.777941:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856813.778343:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426824320 00000100:00100000:3.0:1787856813.778354:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426824320 00010000:00010000:3.0:1787856813.778413:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 50 pid: 9124 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856813.778473:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1787856813.778486:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+50:2402:x1874703426824320:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856813.778509:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856813.778517:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 50 pid: 9124 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.778533:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 50 pid: 9124 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.778587:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c3f3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fa4 expref: 50 pid: 9124 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.778607:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856813.778613:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.778624:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.778634:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.778677:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856813.778760:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+49:2402:x1874703426824320:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 276us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856813.778770:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00010000:00010000:2.0:1787856813.779009:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.779020:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856813.779045:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787856813.779310:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 50 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.779333:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 49 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.779342:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856813.779345:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787856813.779348:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a200, rc 0) 00000100:00100000:2.0:1787856813.779398:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+49:11249:x1874703426824192:12345-192.168.202.6@tcp:101:bash.0 Request processed in 12261us (12531us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787856813.779406:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1787856813.782057:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.782165:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426824576 00000100:00100000:2.0:1787856813.782178:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426824576 00000100:00100000:2.0:1787856813.782284:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:2.0:1787856813.782296:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+49:11249:x1874703426824576:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:2.0:1787856813.783160:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.783206:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.783412:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856813.783482:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1787856813.783510:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fae3811 reply state 00000000325e871c transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.783526:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.783535:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856813.783539:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787856813.783543:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856813.783684:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+52:11249:x1874703426824576:12345-192.168.202.6@tcp:36:bash.0 Request processed in 1386us (1635us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1787856813.783694:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000020:00080000:2.0:1787856813.787040:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787856813.798578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.798672:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426824704 00000100:00100000:2.0:1787856813.798685:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426824704 00000100:00100000:2.0:1787856813.798752:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:2.0:1787856813.798765:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+52:11249:x1874703426824704:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856813.798801:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856813.798829:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fb9 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.798989:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.799016:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 53 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.799027:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.799072:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 53 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.799087:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 53 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856813.799103:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436350848:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856813.799252:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ea180 going to sleep for 11 seconds 00000100:00100000:1.0:1787856813.812495:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856813.812653:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426824832 00000100:00100000:3.0:1787856813.812666:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426824832 00010000:00010000:3.0:1787856813.812738:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 54 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856813.812788:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:3.0:1787856813.812800:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+54:2401:x1874703426824832:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856813.812820:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856813.812827:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 54 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.812868:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 54 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.812899:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856813.812906:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.812928:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.813001:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856813.813027:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856813.813097:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+54:2401:x1874703426824832:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 299us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856813.813107:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00010000:00010000:2.0:1787856813.813425:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb2 expref: 53 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856813.813447:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436350848:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856813.813476:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.813487:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.813494:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856813.813564:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787856813.813579:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856813.813607:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.813646:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb9 expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.813663:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb9 expref: 52 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.813671:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856813.813674:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856813.813676:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37d800, rc 0) 00000100:00100000:2.0:1787856813.813720:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+52:11249:x1874703426824704:12345-192.168.202.6@tcp:101:bash.0 Request processed in 14959us (15160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856813.813728:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:1.0:1787856813.819561:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856813.819685:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426825088 00000100:00100000:0.0:1787856813.819699:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426825088 00000100:00100000:0.0:1787856813.819776:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:0.0:1787856813.819789:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0396050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+52:11249:x1874703426825088:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:0.0:1787856813.820157:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0396050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+53:11249:x1874703426825088:12345-192.168.202.6@tcp:35:bash.0 Request processed in 369us (611us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787856813.820167:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1787856813.947766:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.947924:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426825344 00000100:00100000:2.0:1787856813.947937:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426825344 00000100:00100000:2.0:1787856813.948016:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:2.0:1787856813.948029:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+53:11259:x1874703426825344:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856813.948064:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856813.948090:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37c600/0xc25410d92a3c3f7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fc0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856813.948283:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787856813.948434:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37c600/0xc25410d92a3c3f7b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fc0 expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.948452:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:2.0:1787856813.948473:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787856813.948480:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37c600/0xc25410d92a3c3f7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fc0 expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.948497:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065cd37c600, rc 0) 00000100:00100000:2.0:1787856813.948580:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+54:11259:x1874703426825344:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 554us (829us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787856813.948588:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1787856813.951383:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.951597:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426825472 00000100:00100000:2.0:1787856813.951608:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426825472 00000100:00100000:2.0:1787856813.951678:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:2.0:1787856813.951690:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+54:11259:x1874703426825472:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1787856813.951792:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.951813:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.951827:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.951839:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.951847:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.951854:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952008:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952026:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952034:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856813.952101:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952118:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952126:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952133:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952140:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076be00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856813.952145:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952153:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952166:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856813.952170:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856813.952176:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952183:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076be00/0xc25410d92a3c3f89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952207:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952213:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952249:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952254:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856813.952258:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952265:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952274:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79500) 00010000:00010000:2.0:1787856813.952277:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856813.952280:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952297:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a200/0xc25410d92a3c3f90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952310:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952316:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952322:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952334:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856813.952337:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952344:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952353:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856813.952356:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856813.952360:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856813.952366:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856813.952470:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+54:11259:x1874703426825472:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 781us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856813.952481:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:1.0:1787856813.956275:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856813.957053:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426825728 00000100:00100000:2.0:1787856813.957068:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426825728 00000100:00100000:2.0:1787856813.957143:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1787856813.957156:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+54:11259:x1874703426825728:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787856813.957695:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+55:11259:x1874703426825728:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 540us (1483us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787856813.957704:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00010000:00010000:0.0:1787856813.973427:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856814.021569:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856814.021729:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426825984 00000100:00100000:2.0:1787856814.021743:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426825984 00000100:00100000:2.0:1787856814.021826:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:2.0:1787856814.021856:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+55:11262:x1874703426825984:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856814.021900:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856814.021936:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fc7 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022041:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022059:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022072:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022085:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022093:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022100:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022295:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c3fb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022306:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c3fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022313:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c3fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856814.022335:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787856814.022441:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022449:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022456:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022463:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215bc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856814.022468:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022477:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022491:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856814.022495:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856814.022500:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022507:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c3fa5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.022523:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023261:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023287:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023293:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856814.023297:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023304:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023315:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79500) 00010000:00010000:2.0:1787856814.023317:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856814.023321:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023327:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3fac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023388:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3f9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fc7 expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023405:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c3fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fc7 expref: 57 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.023413:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856814.023415:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856814.023418:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a800, rc 0) 00000100:00100000:2.0:1787856814.023501:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+57:11262:x1874703426825984:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1647us (1946us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787856814.023519:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000001:00080000:2.0:1787856814.028066:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:2.0:1787856814.028128:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1787856814.028246:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028265:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028274:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028281:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9e00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.028287:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028321:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028345:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9065c46a7c00) 00010000:00010000:3.0:1787856814.028349:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856814.028355:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028362:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c3dad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028388:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028394:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028399:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028404:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8c00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.028407:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028413:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028421:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:3.0:1787856814.028423:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856814.028426:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028446:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c3db4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028468:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028474:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028482:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028486:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bae00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.028489:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028494:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028502:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79500) 00010000:00010000:3.0:1787856814.028505:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856814.028508:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028514:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c3df3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028613:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028620:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028633:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028638:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.028640:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028646:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028655:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.028658:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856814.028661:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028666:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c3efd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028678:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028684:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028689:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028694:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.028696:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028713:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028721:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.028723:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856814.028726:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028731:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c3f20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028742:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028748:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028754:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028759:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.028762:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028767:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028775:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.028777:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856814.028779:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.028798:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c3f66 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856814.029855:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856814.030076:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426826112 00000100:00100000:3.0:1787856814.030088:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426826112 00000100:00100000:3.0:1787856814.030190:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:3.0:1787856814.030201:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+29:11262:x1874703426826112:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1787856814.030341:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030362:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030376:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030432:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030443:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030451:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030461:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.030467:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030476:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030510:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.030513:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856814.030522:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.030528:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856814.030704:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+29:11262:x1874703426826112:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 505us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.030713:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:3.0:1787856814.031697:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856814.031727:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065c60e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436350976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787856814.031833:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856814.032257:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436350976 00000100:00100000:0.0:1787856814.032267:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436350976 00000100:00080000:3.0:1787856814.032322:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856814.032357:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787856814.032386:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436350976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787856814.032419:0:8410:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787856814.032460:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9087ab, atime: 0x6a9087ac, ctime: 0x6a9087ab, blocks: 0x8 00010000:00010000:0.0:1787856814.032468:0:8410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856814.032488:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1787856814.032493:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856814.032500:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856814.032520:0:8410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856814.032530:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856814.032537:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856814.032564:0:8410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856814.032635:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856814.032643:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.032651:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856814.032655:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.032665:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.032683:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.032697:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7fcc08/0xc25410d92a3c3fc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.032723:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856814.032725:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856814.032727:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856814.032786:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436350976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 403us (951us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787856814.032794:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000004:00080000:3.0:1787856814.032827:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9065c60e6580/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787856814.032835:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065c60e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436350976:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1787856814.033143:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9064c714c6c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787856814.033155:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065fe702400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9064c714ccc0 00000020:00080000:2.0:1787856814.033158:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065fe702f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9064c7b32200 00000020:00080000:3.0:1787856814.033293:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787856814.033501:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787856814.036609:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856814.036760:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426826240 00000100:00100000:3.0:1787856814.036773:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426826240 00000100:00100000:3.0:1787856814.036859:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:3.0:1787856814.036873:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+13:2401:x1874703426826240:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856814.036968:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856814.037012:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c3fb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fc7 expref: 13 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.037043:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.037049:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856814.037186:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+12:2401:x1874703426826240:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 316us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.037199:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1787856814.040653:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856814.040723:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426826496 00000100:00100000:0.0:1787856814.040737:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426826496 00000100:00100000:0.0:1787856814.040813:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:0.0:1787856814.040843:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+12:11262:x1874703426826496:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1787856814.041467:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+13:11262:x1874703426826496:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 625us (829us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787856814.041478:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:0.0:1787856814.196495:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856814.196704:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426826752 00000100:00100000:3.0:1787856814.196716:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426826752 00000100:00100000:3.0:1787856814.196827:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:3.0:1787856814.196840:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+13:11280:x1874703426826752:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:3.0:1787856814.196874:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856814.196919:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3fcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fce expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.197073:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fd6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.197101:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.197115:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856814.197135:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787856814.197346:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3fcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fce expref: 16 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.197369:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fce expref: 15 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.197380:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.197384:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787856814.197388:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff200, rc 0) 00000100:00100000:3.0:1787856814.197471:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+15:11280:x1874703426826752:12345-192.168.202.6@tcp:101:cat.0 Request processed in 633us (990us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1787856814.197480:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:1.0:1787856814.238186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856814.238310:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426826880 00000100:00100000:2.0:1787856814.238328:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426826880 00000100:00100000:2.0:1787856814.238413:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:2.0:1787856814.238424:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+15:11281:x1874703426826880:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856814.238451:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856814.238475:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3fe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fd5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.238542:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3feb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.238557:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.238569:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856814.238613:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787856814.238616:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856814.238647:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.238693:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3fe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fd5 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.238712:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3feb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fd5 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.238722:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856814.238725:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856814.238729:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b400, rc 0) 00000100:00100000:2.0:1787856814.238802:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+16:11281:x1874703426826880:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 379us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856814.238809:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:1.0:1787856814.246950:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856814.247049:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426827264 00000100:00100000:2.0:1787856814.247059:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426827264 00000100:00100000:2.0:1787856814.247116:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:2.0:1787856814.247133:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+16:11281:x1874703426827264:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787856814.247436:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+17:11281:x1874703426827264:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 304us (495us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787856814.247444:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1787856814.252826:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856814.260239:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426827392 00000100:00100000:3.0:1787856814.260275:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426827392 00000100:00100000:3.0:1787856814.260366:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1787856814.260379:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+17:11281:x1874703426827392:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:3.0:1787856814.260396:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787856814.260423:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065cd37d800/0xc25410d92a3c3f74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fb9 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.260451:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c3fd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fce expref: 16 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.260465:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c3e71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f73 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.260475:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.260481:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856814.260617:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+14:11281:x1874703426827392:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 241us (7799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.260634:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1787856814.267886:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856814.267993:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426827520 00000100:00100000:2.0:1787856814.268003:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426827520 00000100:00100000:2.0:1787856814.268057:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:2.0:1787856814.268066:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8216940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+14:11281:x1874703426827520:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:2.0:1787856814.268194:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.268247:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.268260:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856814.268479:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856814.268607:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787856814.268681:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787856814.268758:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8216940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+14:11281:x1874703426827520:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 692us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856814.268767:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:1.0:1787856814.308549:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856814.308649:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426827648 00000100:00100000:3.0:1787856814.308666:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426827648 00000100:00100000:3.0:1787856814.308758:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:3.0:1787856814.308771:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8215a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+14:11283:x1874703426827648:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1787856814.308798:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856814.308823:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3ff9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fdc expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.308925:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.308959:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.308974:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.308992:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.308998:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309005:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309091:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309100:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309107:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856814.309467:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787856814.309474:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787856814.309499:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309514:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309537:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309544:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309550:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309556:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.309560:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309568:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309582:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:3.0:1787856814.309586:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856814.309592:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309598:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c4000 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309616:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309622:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309628:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309642:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.309645:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309650:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309659:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c46a7c00) 00010000:00010000:3.0:1787856814.309661:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856814.309664:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309669:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4007 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309705:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c3ff9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 16 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309720:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 15 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.309728:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.309730:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787856814.309733:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fec00, rc 0) 00000100:00100000:3.0:1787856814.309886:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8215a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+15:11283:x1874703426827648:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1117us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.309896:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:0.0:1787856814.418451:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065c60e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436351104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856814.418550:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856814.418666:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436351104 00000100:00100000:0.0:1787856814.418675:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436351104 00000100:00100000:0.0:1787856814.418746:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787856814.418772:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436351104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856814.418816:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856814.418869:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436351104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856814.418878:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1787856814.418915:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856814.418964:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065c60e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436351104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856814.419339:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436351360:0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.419401:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856814.419434:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436351872:0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.419445:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436351360 00000100:00100000:1.0:1787856814.419451:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436351360 00000100:00100000:3.0:1787856814.419464:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856814.419488:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436352384:0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.419496:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787856814.419506:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436351360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.419519:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856814.419545:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787856814.419553:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436351488:0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.419560:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436351360:12345-0@lo:400:kworker.0 Request processed in 54us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856814.419577:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787856814.419595:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856814.419621:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436352000:0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.419638:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436352384 00000100:00100000:1.0:1787856814.419643:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436352384 00000100:00100000:3.0:1787856814.419650:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856814.419674:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436352512:0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.419680:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436352000 00000100:00100000:1.0:1787856814.419684:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436352000 00000100:00100000:3.0:1787856814.419706:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856814.419707:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787856814.419718:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436352384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.419744:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436351360:0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.419764:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436352896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856814.419767:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436352384:12345-0@lo:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856814.419775:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787856814.419788:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787856814.419799:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856814.419799:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436352000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.419839:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436352000:12345-0@lo:400:kworker.0 Request processed in 44us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.419840:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436352384:0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.419849:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787856814.419869:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436351872 00000100:00100000:3.0:1787856814.419873:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436352000:0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.419874:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436351872 00000100:00100000:1.0:1787856814.419891:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436351488 00000100:00100000:1.0:1787856814.419895:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436351488 00000100:00100000:1.0:1787856814.419923:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787856814.419931:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436351872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.419946:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436352896 00000100:00100000:3.0:1787856814.419952:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436352896 00000100:00100000:1.0:1787856814.419970:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436351872:12345-0@lo:400:kworker.0 Request processed in 39us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856814.419976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787856814.419988:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787856814.419993:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787856814.420001:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436352896:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856814.420003:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436351488:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787856814.420032:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787856814.420054:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436351488:12345-0@lo:400:kworker.0 Request processed in 54us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856814.420061:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787856814.420078:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436352896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.420093:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787856814.420103:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436352896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856814.420117:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436351488:0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.420119:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436352512 00000100:00100000:1.0:1787856814.420128:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436351872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.420251:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436352512 00000100:00100000:3.0:1787856814.420287:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787856814.420294:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436352512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.420329:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436352512:12345-0@lo:400:kworker.0 Request processed in 35us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.420335:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787856814.420550:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436351232:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.420595:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856814.420627:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436351744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856814.420652:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856814.420672:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436352256:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.420696:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856814.420719:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436352768:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.420741:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856814.420819:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787856814.420826:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436351616:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.420851:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856814.420871:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436352128:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.420893:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856814.421165:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436352256 00000100:00100000:1.0:1787856814.421170:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436352256 00000100:00100000:1.0:1787856814.421208:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436351616 00000100:00100000:1.0:1787856814.421211:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436351616 00000100:00100000:1.0:1787856814.421246:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436352128 00000100:00100000:1.0:1787856814.421249:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436352128 00000100:00100000:1.0:1787856814.421266:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787856814.421274:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436352256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.421318:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436352256:12345-0@lo:400:kworker.0 Request processed in 45us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856814.421325:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787856814.421339:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787856814.421345:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436351616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.421373:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436351616:12345-0@lo:400:kworker.0 Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856814.421379:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787856814.421392:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787856814.421552:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436352640:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.421583:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787856814.421612:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83ce940 x1874703436352256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856814.421626:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436352256:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.421649:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436351616:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.421675:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436351744 00000100:00100000:0.0:1787856814.421678:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436351744 00000100:00100000:0.0:1787856814.421713:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787856814.421720:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436351744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856814.421737:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856814.422010:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436351232 00000100:00100000:3.0:1787856814.422015:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436351232 00000100:00100000:3.0:1787856814.422056:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787856814.422064:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436351232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.422110:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065f5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436351232:12345-0@lo:400:kworker.0 Request processed in 47us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.422116:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787856814.422148:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436352640 00000100:00100000:3.0:1787856814.422151:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436352640 00000100:00100000:3.0:1787856814.422169:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787856814.422175:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436352640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856814.422199:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436352640:12345-0@lo:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.422205:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787856814.422525:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436351744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 806us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856814.422532:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1787856814.422554:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856814.422560:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856814.422562:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856814.422565:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856814.422582:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436352768 00000100:00100000:0.0:1787856814.422593:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436352768 00000100:00100000:0.0:1787856814.422616:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787856814.422621:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436352768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.422654:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436352768:12345-0@lo:400:kworker.0 Request processed in 33us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856814.422660:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1787856814.422701:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83ce1c0 x1874703436352640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856814.422714:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436352640:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.422724:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436351232:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.422743:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436351744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856814.422844:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436352128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856814.422881:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436352128:12345-0@lo:400:kworker.0 Request processed in 1484us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856814.422894:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787856814.422948:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436352512:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.423639:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436352768:0@lo:400:kworker.0 00000100:00100000:0.0:1787856814.423684:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436352128:0@lo:400:kworker.0 00000040:00080000:3.0:1787856814.931164:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856814.931175:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856814.931729:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787856814.931742:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787856814.931967:0:13777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436353024:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787856814.932168:0:13777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856814.932537:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436353152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856814.932599:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856814.932659:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436353152 00000100:00100000:3.0:1787856814.932666:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436353152 00000100:00100000:3.0:1787856814.932722:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787856814.932732:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1874703436353152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856814.932759:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787856814.932810:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1874703436353152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.932819:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787856814.932873:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436353152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856814.945520:0:13777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826fc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436353024:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787856814.954145:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856814.955317:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426827776 00000100:00100000:3.0:1787856814.955333:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426827776 00000100:00100000:3.0:1787856814.955439:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:3.0:1787856814.955450:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+15:11294:x1874703426827776:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787856814.955498:0:9124:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787856814.955679:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+15:11294:x1874703426827776:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 230us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856814.955689:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:1.0:1787856814.963253:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856814.963452:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426827904 00000100:00100000:2.0:1787856814.963465:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426827904 00000100:00100000:2.0:1787856814.963725:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:2.0:1787856814.963739:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+15:11294:x1874703426827904:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787856814.963833:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.963854:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.963868:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.964056:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.964106:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.964120:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.964157:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.964167:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.964173:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856814.964276:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787856814.964281:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856814.965206:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.965286:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.965294:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966016:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966023:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856814.966027:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966052:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966073:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:2.0:1787856814.966076:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856814.966081:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966087:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4015 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966107:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966112:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966117:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966122:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856814.966124:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966130:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966137:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9064c793d500) 00010000:00010000:2.0:1787856814.966140:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856814.966143:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966162:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c401c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966183:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966189:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966196:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966201:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856814.966203:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.966210:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.967597:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856814.967606:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856814.967613:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.967623:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4023 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856814.967790:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+15:11294:x1874703426827904:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 4050us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856814.967801:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:1.0:1787856814.974157:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856814.974312:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426828160 00000100:00100000:3.0:1787856814.974400:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426828160 00000100:00100000:3.0:1787856814.974480:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:3.0:1787856814.974493:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+15:11294:x1874703426828160:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787856814.974536:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856814.974566:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c402a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fe3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.974715:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.974734:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.974750:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856814.974764:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787856814.975524:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975539:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975547:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975553:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856814.975558:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975567:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975586:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856814.975596:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787856814.975603:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975610:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4031 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975670:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c402a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fe3 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975683:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:3.0:1787856814.975686:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856814.975690:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c402a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fe3 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856814.975701:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe400, rc 0) 00000100:00100000:3.0:1787856814.975788:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+16:11294:x1874703426828160:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1298us (1646us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1787856814.975799:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:3.0:1787856814.981117:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856814.981545:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426828288 00000100:00100000:1.0:1787856814.981559:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426828288 00000100:00100000:1.0:1787856814.981637:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:1.0:1787856814.981650:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+16:11294:x1874703426828288:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787856814.981701:0:9124:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787856814.981867:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+16:11294:x1874703426828288:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 220us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856814.981876:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:3.0:1787856814.987493:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856814.987984:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426828544 00000100:00100000:2.0:1787856814.988003:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426828544 00000100:00100000:2.0:1787856814.988087:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:2.0:1787856814.988099:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+16:11294:x1874703426828544:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856814.988122:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856814.988126:0:8909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787856814.988153:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c3feb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fd5 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.988173:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856814.988178:0:8909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856814.988190:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c403f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fea expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787856814.988743:0:8909:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787856814.990080:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4046 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.990100:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.990112:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.990174:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c403f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fea expref: 18 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.990192:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fea expref: 17 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856814.990237:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d500) 00010000:00010000:2.0:1787856814.990240:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856814.990245:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a600, rc 0) 00000100:00100000:2.0:1787856814.991415:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+17:11294:x1874703426828544:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3312us (4606us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787856814.991428:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00010000:00010000:2.0:1787856814.995466:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856815.005928:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856815.006041:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426828800 00000100:00100000:1.0:1787856815.006058:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426828800 00000100:00080000:2.0:1787856815.006149:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856815.006177:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:1.0:1787856815.006193:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+17:11294:x1874703426828800:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787856815.006309:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856815.006346:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4046 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fea expref: 17 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006370:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d500) 00010000:00010000:1.0:1787856815.006382:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787856815.006589:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006629:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006642:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006661:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006668:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006674:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006733:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006741:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006749:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006756:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856815.006761:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006771:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006780:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856815.006790:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856815.006795:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006802:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4054 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006814:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006821:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006827:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006833:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856815.006836:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006841:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006849:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x92321820 (ffff9065c3c5fa00) 00010000:00010000:1.0:1787856815.006852:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856815.006855:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.006862:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c405b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x92321820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856815.006992:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+16:11294:x1874703426828800:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 802us (1073us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787856815.007007:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:3.0:1787856815.012873:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.013991:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426828928 00000100:00100000:2.0:1787856815.014004:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426828928 00000100:00100000:2.0:1787856815.014065:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:2.0:1787856815.014075:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+16:11294:x1874703426828928:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856815.014099:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856815.014122:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4062 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ff1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.014158:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.014173:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.014186:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.014323:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4062 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.014355:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.014363:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:2.0:1787856815.014366:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787856815.014369:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b400, rc 0) 00000100:00100000:2.0:1787856815.014425:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+17:11294:x1874703426828928:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 352us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856815.014432:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:0.0:1787856815.028464:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.035943:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426829184 00000100:00100000:3.0:1787856815.035957:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426829184 00000100:00100000:3.0:1787856815.036032:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:3.0:1787856815.036043:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+17:11294:x1874703426829184:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787856815.036139:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.036168:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.036180:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787856815.036390:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787856815.036400:0:8909:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348746182300ns, next at 349746180083ns, rc = 0 00000004:00010000:3.0:1787856815.036449:0:8909:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6ff5985 reply state 000000006c09df77 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.036479:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.036488:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:3.0:1787856815.036491:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787856815.036495:0:8909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787856815.036599:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+19:11294:x1874703426829184:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 558us (8151us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787856815.036607:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:3.0:1787856815.042944:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856815.043031:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426829312 00000100:00100000:0.0:1787856815.043048:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426829312 00000100:00100000:0.0:1787856815.043148:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:0.0:1787856815.043174:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+19:11294:x1874703426829312:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856815.043212:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856815.043265:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5ff8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.043357:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.043398:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.043423:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:0.0:1787856815.043427:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787856815.043432:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bac00, rc 0) 00000100:00100000:0.0:1787856815.043511:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+20:11294:x1874703426829312:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 352us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856815.043519:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:0.0:1787856815.047279:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.047496:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426829440 00000100:00100000:2.0:1787856815.047505:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426829440 00000100:00100000:2.0:1787856815.047543:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:2.0:1787856815.047551:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874703426829440:12345-192.168.202.6@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787856815.047589:0:10490:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:2.0:1787856815.047625:0:10490:0:(genops.c:1385:class_connect()) connect: client 898e91b3-529b-44bc-a821-726bff6c71d4, cookie 0xc25410d92a3c407e 00002000:00100000:2.0:1787856815.047639:0:10490:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 898e91b3-529b-44bc-a821-726bff6c71d4/ffff906601a72000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787856815.047651:0:10490:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1787856815.047726:0:10490:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787856815.047756:0:10490:0:(import.c:65:import_set_state_nolock()) ffff906601a70800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856815.047936:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2398:x1874703426829440:12345-192.168.202.6@tcp:8:lhsmtool_posix.0 Request processed in 383us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856815.047945:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:0.0:1787856815.075481:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856815.075586:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426829568 00000100:00100000:1.0:1787856815.075596:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426829568 00000100:00100000:1.0:1787856815.075665:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:1.0:1787856815.075675:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:0:x1874703426829568:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787856815.076277:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787856815.083792:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1787856815.083806:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000100:00100000:1.0:1787856815.084078:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:0:x1874703426829568:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 8397us (8600us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787856815.084090:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1787856815.091576:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.091691:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426829824 00000100:00100000:2.0:1787856815.091711:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426829824 00000100:00100000:2.0:1787856815.091772:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:2.0:1787856815.091791:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+20:11294:x1874703426829824:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787856815.092036:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+21:11294:x1874703426829824:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 246us (469us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787856815.092045:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1787856815.096748:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.096861:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426830080 00000100:00100000:3.0:1787856815.096871:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426830080 00000100:00100000:3.0:1787856815.096942:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:3.0:1787856815.096953:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+21:11294:x1874703426830080:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787856815.097069:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+21:11294:x1874703426830080:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 118us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856815.097088:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:3.0:1787856815.100664:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856815.100721:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426830208 00000100:00100000:1.0:1787856815.100730:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426830208 00000100:00100000:1.0:1787856815.100790:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:1.0:1787856815.100800:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+21:11294:x1874703426830208:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856815.100829:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856815.100849:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4085 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a5fff expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.100926:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c408c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.100941:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c408c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.100954:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c408c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856815.100995:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856815.101011:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c408c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.101044:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fff expref: 23 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.101062:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c408c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fff expref: 22 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.101072:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:1.0:1787856815.101075:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787856815.101078:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939000, rc 0) 00000100:00100000:1.0:1787856815.101142:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+22:11294:x1874703426830208:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 343us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856815.101149:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:3.0:1787856815.117687:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.117780:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426830336 00000100:00100000:2.0:1787856815.117790:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426830336 00000100:00100000:2.0:1787856815.117852:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:2.0:1787856815.117863:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426830336:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856815.117891:0:10490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856815.117922:0:10490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6006 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856815.117951:0:10490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9087af, blocks: 0x0 00010000:00010000:2.0:1787856815.118081:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1787856815.118090:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856815.118100:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 6 pid: 10490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.118123:0:10490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 6 pid: 10490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.118137:0:10490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b600, rc 0) 00000100:00100000:2.0:1787856815.118198:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426830336:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 337us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856815.118238:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:3.0:1787856815.126827:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.126944:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426830592 00000100:00100000:2.0:1787856815.126954:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426830592 00000100:00100000:2.0:1787856815.127028:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:2.0:1787856815.127040:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+22:11294:x1874703426830592:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787856815.127146:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+22:11294:x1874703426830592:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856815.127155:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:3.0:1787856815.146959:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.147012:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426830720 00000100:00100000:3.0:1787856815.147020:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426830720 00000100:00100000:3.0:1787856815.147068:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1787856815.147077:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:11294:x1874703426830720:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787856815.147094:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856815.147111:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a600d expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.147142:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 7 pid: 10490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.147152:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856815.147156:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856815.147161:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.147194:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 7 pid: 10490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.147208:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 7 pid: 10490 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.147262:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436353280:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856815.147359:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856815.152092:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436353280:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856815.152128:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.152149:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fea00, rc 0) 00000100:00100000:0.0:1787856815.152212:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:11294:x1874703426830720:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 5134us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856815.152249:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:0.0:1787856815.173115:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.173421:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426830848 00000100:00100000:3.0:1787856815.173431:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426830848 00010000:00010000:3.0:1787856815.173474:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 7 pid: 10490 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.173512:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:3.0:1787856815.173521:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426830848:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856815.173535:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856815.173558:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 7 pid: 10490 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.173573:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 7 pid: 10490 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.173601:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4093 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6006 expref: 7 pid: 10490 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.173617:0:13165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856815.173622:0:13165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856815.173631:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.173655:0:13165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.176373:0:13165:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.176400:0:13165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13165:1874703436353408:192.168.202.6@tcp:105: 00000100:00100000:3.0:1787856815.176533:0:13165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856815.194576:0:13165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13165:1874703436353408:192.168.202.6@tcp:105: 00010000:00010000:3.0:1787856815.194602:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856815.194671:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426830848:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 21150us (21564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856815.194684:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:0.0:1787856815.196340:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.196409:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426830976 00000100:00100000:3.0:1787856815.196418:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426830976 00002000:00100000:3.0:1787856815.196461:0:8415:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9064c83852c0 x1874703426830976/t0(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:216/0 lens 504/0 e 0 to 0 dl 1787856826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856815.196473:0:8415:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c83852c0 with x1874703426830976 ext(0->8) 00002000:00010000:3.0:1787856815.196479:0:8415:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9064c83852c0 00000100:00100000:3.0:1787856815.196510:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1787856815.196520:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426830976:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787856815.199490:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426830976:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 2954us (3140us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787856815.199524:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00002000:00100000:3.0:1787856815.199543:0:8415:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9064c83852c0 x1874703426830976/t4294967303(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:216/0 lens 504/448 e 0 to 0 dl 1787856826 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856815.199554:0:8415:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c83852c0 with x1874703426830976 ext(0->8) 00002000:00010000:3.0:1787856815.199562:0:8415:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9064c83852c0 00000100:00100000:0.0:1787856815.202686:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.203185:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426831104 00000100:00100000:2.0:1787856815.203195:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426831104 00000100:00100000:2.0:1787856815.203286:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:2.0:1787856815.203297:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+22:11294:x1874703426831104:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787856815.206174:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1787856815.206190:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787856815.206254:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787856815.206280:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787856815.206291:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1787856815.206381:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.206394:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.206401:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.206408:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856815.206413:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.206421:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856815.206436:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+15:11294:x1874703426831104:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 3135us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856815.206454:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 90 00010000:00010000:2.0:1787856815.206464:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:2.0:1787856815.206468:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787856815.206474:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.206481:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4070 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856815.208128:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436353536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787856815.208193:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856815.208415:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436353536 00000100:00100000:1.0:1787856815.208423:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436353536 00000100:00100000:1.0:1787856815.208561:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787856815.208571:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436353536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787856815.208691:0:10490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787856815.208695:0:10490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787856815 00002000:00010000:1.0:1787856815.208697:0:10490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787856815.208699:0:10490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787856815 -> 1787856815 00002000:00010000:1.0:1787856815.208702:0:10490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787856815.208750:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436353536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (556us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787856815.208757:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000004:00080000:2.0:1787856815.210131:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9064c83cde00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787856815.210142:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436353536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787856815.214030:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.216406:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426831232 00000100:00100000:3.0:1787856815.216422:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426831232 00000100:00100000:3.0:1787856815.216489:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1787856815.216503:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2401:x1874703426831232:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787856815.219402:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1787856815.219424:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1787856815.221615:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426831232:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 5104us (7583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856815.221647:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1787856815.230975:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856815.234021:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426831488 00000100:00100000:0.0:1787856815.234036:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426831488 00000100:00100000:0.0:1787856815.234098:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:0.0:1787856815.234108:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+14:11294:x1874703426831488:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787856815.234160:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856815.234192:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c408c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fff expref: 14 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.234210:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:0.0:1787856815.234233:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856815.234263:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.234276:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.234285:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856815.234402:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f5e0a7e reply state 00000000988bb571 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.234427:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.234433:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:0.0:1787856815.234435:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856815.234438:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856815.234541:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+15:11294:x1874703426831488:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 434us (3581us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787856815.234548:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:3.0:1787856815.239565:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.239941:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426831616 00000100:00100000:2.0:1787856815.239952:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426831616 00000100:00100000:2.0:1787856815.240033:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:2.0:1787856815.240045:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426831616:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787856815.240239:0:10490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787856815.240243:0:10490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787856815 -> 1787856813 00002000:00010000:2.0:1787856815.240247:0:10490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787856812 00002000:00010000:2.0:1787856815.240250:0:10490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787856815 -> 1787856813 00002000:00010000:2.0:1787856815.240253:0:10490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787856815.240319:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426831616:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 277us (763us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787856815.240329:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:0.0:1787856815.249421:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.249576:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426831872 00000100:00100000:3.0:1787856815.249586:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426831872 00000100:00100000:3.0:1787856815.249644:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:3.0:1787856815.249653:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+15:11294:x1874703426831872:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787856815.249718:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.249734:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.249743:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.249790:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.249804:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 15 pid: 6497 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.249819:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8361e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436353664:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856815.249914:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856815.255424:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8361e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436353664:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856815.255453:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856815.258357:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.258482:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426832000 00000100:00100000:2.0:1787856815.258500:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426832000 00010000:00010000:2.0:1787856815.258539:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 16 pid: 6497 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856815.258587:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:2.0:1787856815.258596:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+16:2402:x1874703426832000:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856815.258611:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856815.258619:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 16 pid: 6497 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.258632:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 16 pid: 6497 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.258655:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4069 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff1 expref: 16 pid: 6497 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.258670:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:2.0:1787856815.258675:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.258685:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.258694:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.258728:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856815.258778:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+15:2402:x1874703426832000:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 183us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856815.258795:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00010000:00010000:1.0:1787856815.258967:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.258976:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.259013:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.259019:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.259025:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.259031:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856815.259035:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.259042:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.259051:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:1.0:1787856815.259054:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787856815.259057:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.259062:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c40a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856815.259130:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+14:11294:x1874703426831872:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 9478us (9718us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787856815.259140:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:0.0:1787856815.286829:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.286913:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426832128 00000100:00100000:3.0:1787856815.286925:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426832128 00000100:00100000:3.0:1787856815.286985:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:3.0:1787856815.286994:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8387c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426832128:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787856815.287037:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.287057:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.287065:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856815.287069:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787856815.287074:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.287128:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.287142:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 7 pid: 8407 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.287158:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8361e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436353792:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856815.287261:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787856815.311913:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856815.312021:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426832256 00000100:00100000:1.0:1787856815.312031:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426832256 00010000:00010000:1.0:1787856815.312072:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 8 pid: 8407 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856815.312117:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1787856815.312127:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426832256:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856815.312141:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856815.312164:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 8 pid: 8407 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.312177:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 8 pid: 8407 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.312205:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787856815.312210:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787856815.312243:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856815.312253:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.312882:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c409a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a600d expref: 8 pid: 8407 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.312908:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8361e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436353792:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856815.312928:0:8407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.312939:0:8407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.312946:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.312967:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.312990:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.312998:0:8407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.313006:0:8407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856815.313010:0:8407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.313019:0:8407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.313034:0:8407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.313042:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c40af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.313111:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8387c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426832128:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 26117us (26291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856815.313119:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00010000:00010000:1.0:1787856815.313164:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856815.313190:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426832256:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1064us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856815.313198:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1787856815.315763:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.315857:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426832512 00000100:00100000:3.0:1787856815.315867:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426832512 00000100:00100000:3.0:1787856815.315943:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:3.0:1787856815.315966:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+14:11294:x1874703426832512:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787856815.316046:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.316064:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.316073:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.316109:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.316122:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 14 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.316137:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8361e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436353920:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856815.316245:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787856815.318541:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8361e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436353920:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856815.318565:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856815.319795:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.330265:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426832640 00000100:00100000:3.0:1787856815.330280:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426832640 00010000:00010000:3.0:1787856815.330324:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 15 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.330441:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1787856815.330451:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+15:2401:x1874703426832640:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856815.330464:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856815.330470:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 15 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330487:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 15 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330511:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c3ef6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f96 expref: 15 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330523:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856815.330528:0:13166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330538:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330545:0:13166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330569:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856815.330624:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+14:2401:x1874703426832640:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 174us (10835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856815.330631:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00010000:00010000:3.0:1787856815.330681:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330688:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330840:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330861:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.330868:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.331248:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.331262:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 14 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.331276:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8363c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436354048:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856815.331322:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a480 going to sleep for 11 seconds 00000040:00080000:1.0:1787856815.335689:0:14188:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787856815.335699:0:14188:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787856815.335724:0:14188:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787856815.335731:0:14188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787856815.339794:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856815.345144:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8363c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436354048:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856815.345184:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856815.345250:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426832768 00000100:00100000:2.0:1787856815.345258:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426832768 00010000:00010000:2.0:1787856815.345302:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 15 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856815.345344:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1787856815.345353:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+15:2402:x1874703426832768:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856815.345370:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856815.345377:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 15 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.345388:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 15 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.345410:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4077 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5ff8 expref: 15 pid: 6496 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.345433:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:2.0:1787856815.345438:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.345446:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.345452:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.345475:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856815.345529:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+14:2402:x1874703426832768:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 177us (5743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856815.345537:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00010000:00010000:2.0:1787856815.345562:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856815.345570:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856815.345676:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787856815.345789:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1787856815.348496:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1787856815.348630:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066019883c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8909:1874703436354176:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787856815.348697:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856815.348732:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856815.349032:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436354176 00000100:00100000:3.0:1787856815.349040:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436354176 00000100:00100000:3.0:1787856815.349092:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787856815.349102:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8909:x1874703436354176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787856815.349195:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8909:x1874703436354176:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856815.349203:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787856815.349727:0:8909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787856815.349734:0:8909:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9064c83cde00, transno 4294967304 00000100:00100000:2.0:1787856815.349755:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066019883c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8909:1874703436354176:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787856815.349918:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1787856815.349969:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066019883c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8909:1874703436354304:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787856815.350002:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856815.350020:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c70013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856815.355038:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436354304 00000100:00100000:3.0:1787856815.355053:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436354304 00000100:00100000:3.0:1787856815.356005:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787856815.356019:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8909:x1874703436354304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787856815.356390:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8909:x1874703436354304:12345-0@lo:1000:mdt00_003.0 Request processed in 374us (6385us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787856815.356399:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787856815.356492:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066019883c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8909:1874703436354304:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787856815.356544:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356555:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356563:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356570:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856815.356575:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356583:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356611:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:0.0:1787856815.356614:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787856815.356619:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356626:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c40bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356658:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356664:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356669:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356673:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856815.356676:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356681:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356688:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856815.356690:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787856815.356693:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356698:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c3ff2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356729:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356743:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 17 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356752:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356782:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 17 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.356796:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 17 pid: 9124 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856815.356823:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8387480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436354432:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856815.356915:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856815.367516:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8387480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436354432:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856815.367545:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856815.376051:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856815.376497:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426832896 00000100:00100000:3.0:1787856815.376507:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426832896 00010000:00010000:3.0:1787856815.376546:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 18 pid: 9124 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856815.376740:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1787856815.376751:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:2402:x1874703426832896:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856815.376767:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856815.376774:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 18 pid: 9124 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.376788:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 18 pid: 9124 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.376820:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c400e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5fdc expref: 18 pid: 9124 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.376841:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856815.376846:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.376866:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.376873:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856815.376923:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856815.376977:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+17:2402:x1874703426832896:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 227us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856815.376986:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00010000:00010000:0.0:1787856815.377078:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377086:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377098:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377104:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377133:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377139:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856815.377143:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377150:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377159:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856815.377162:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856815.377166:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377172:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c40c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377183:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377189:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377194:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377199:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fee00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856815.377202:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377265:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377275:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856815.377277:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787856815.377281:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.377288:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c40b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856815.377428:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+16:11294:x1874703426832512:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 61462us (61672us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787856815.377437:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 93 00000020:00080000:0.0:1787856815.377441:0:8909:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787856815.381482:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787856815.381492:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787856815.381530:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787856815.381537:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787856815.386615:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856815.386706:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426833152 00000100:00100000:0.0:1787856815.386716:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426833152 00000100:00100000:0.0:1787856815.386776:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1787856815.386787:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+16:11294:x1874703426833152:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787856815.387261:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787856815.387292:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1787856815.387324:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387341:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387354:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387379:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387385:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387390:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387407:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787856815.387496:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:11294:x1874703426833152:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 710us (889us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787856815.387504:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000020:00080000:0.0:1787856815.387509:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787856815.387534:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856815.387541:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387548:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007baa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856815.387552:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387560:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387572:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:0.0:1787856815.387575:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787856815.387580:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387596:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c40cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856815.387608:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856815.387610:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856815.387612:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856815.442439:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436354560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856815.442512:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856815.442701:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436354560 00000100:00100000:1.0:1787856815.442709:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436354560 00000100:00100000:1.0:1787856815.442762:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787856815.442771:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601989a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436354560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856815.442805:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787856815.442866:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601989a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436354560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856815.442874:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787856815.443073:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436354560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856815.953776:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856815.953799:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436354688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856815.953888:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856815.954948:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436354688 00000100:00100000:2.0:1787856815.954958:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436354688 00000100:00100000:2.0:1787856815.955015:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787856815.955025:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436354688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856815.955061:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787856815.955476:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436354688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 452us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856815.955484:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787856815.955652:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436354688:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787856816.018163:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856817.041467:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856817.634452:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856817.634496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856817.634562:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426833280 00000100:00100000:3.0:1787856817.634571:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426833280 00000100:00100000:3.0:1787856817.634620:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 384 00000100:00100000:3.0:1787856817.634629:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2402:x1874703426833280:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856817.634696:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2402:x1874703426833280:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.634705:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 384 00000100:00100000:0.0:1787856817.635500:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856817.635522:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856817.635569:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426833792 00000100:00100000:3.0:1787856817.635574:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426833792 00000100:00100000:3.0:1787856817.635619:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:3.0:1787856817.635626:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426833792:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856817.635664:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426833792:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.635671:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00080000:3.0:1787856817.635694:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856817.641537:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856817.641924:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426833536 00000100:00100000:2.0:1787856817.641934:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426833536 00000100:00100000:3.0:1787856817.642035:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426834048 00000100:00100000:3.0:1787856817.642039:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426834048 00000100:00100000:3.0:1787856817.642065:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 305 00000100:00100000:3.0:1787856817.642074:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426833536:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856817.642145:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426833536:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 71us (7647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.642152:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 305 00000100:00100000:3.0:1787856817.642169:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 306 00000100:00100000:3.0:1787856817.642175:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426834048:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856817.642198:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426834048:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (6676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.642204:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 306 00000100:00080000:3.0:1787856817.642242:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856817.644509:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856817.644542:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856817.645835:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426833408 00000100:00100000:3.0:1787856817.645848:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426833408 00000100:00100000:3.0:1787856817.645918:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426833920 00000100:00100000:3.0:1787856817.645921:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426833920 00000100:00100000:3.0:1787856817.645944:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 307 00000100:00100000:3.0:1787856817.645954:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:2402:x1874703426833408:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856817.646036:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:2402:x1874703426833408:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (4507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.646043:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 307 00000100:00100000:3.0:1787856817.646061:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 308 00000100:00100000:3.0:1787856817.646067:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426833920:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856817.646091:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426833920:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.646103:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 308 00000100:00080000:3.0:1787856817.646121:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787856817.646777:0:14241:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856817.646782:0:14241:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856817.646816:0:14241:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787856817.646823:0:14241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787856817.649150:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426833664 00000100:00100000:2.0:1787856817.649163:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426833664 00000100:00100000:2.0:1787856817.649247:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:2.0:1787856817.649257:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8384780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426833664:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856817.650036:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8384780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426833664:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 777us (5531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856817.650046:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00080000:2.0:1787856817.650078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856817.794573:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856817.794723:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426834304 00000100:00100000:1.0:1787856817.794733:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426834304 00000100:00100000:1.0:1787856817.794796:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:1.0:1787856817.794805:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:11313:x1874703426834304:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856817.794825:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856817.794844:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c40d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6014 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.794985:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c40d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.794999:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c40d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.795013:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c40d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856817.795023:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787856817.795138:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c40d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6014 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.795157:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c40d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6014 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.795165:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856817.795168:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787856817.795172:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939400, rc 0) 00000100:00100000:1.0:1787856817.795257:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+20:11313:x1874703426834304:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 453us (695us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787856817.795265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:0.0:1787856817.811731:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856817.811764:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426834432 00000100:00100000:0.0:1787856817.811774:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426834432 00000100:00100000:0.0:1787856817.811826:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:0.0:1787856817.811836:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+20:11313:x1874703426834432:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1787856817.811920:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.811939:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.811966:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.811983:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.811991:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.811997:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812075:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812084:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812104:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856817.812153:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812166:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812172:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812179:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812195:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856817.812199:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812208:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812252:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:0.0:1787856817.812256:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856817.812262:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812268:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c40e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812280:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812287:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812293:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812298:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856817.812301:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812306:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812324:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c5b79100) 00010000:00010000:0.0:1787856817.812326:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856817.812329:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812333:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c40ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812348:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812354:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812359:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812364:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bae00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856817.812367:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812372:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812379:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856817.812381:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856817.812384:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.812389:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c40f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856817.812464:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+20:11313:x1874703426834432:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 629us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856817.812745:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:2.0:1787856817.878597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856817.878707:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426834688 00000100:00100000:1.0:1787856817.878717:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426834688 00000100:00100000:1.0:1787856817.878789:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:1.0:1787856817.878799:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+20:11316:x1874703426834688:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856817.878821:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856817.878855:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c40fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a601b expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.878945:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.878961:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.878972:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.878988:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.878996:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879002:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879123:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879131:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879138:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856817.879149:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787856817.879278:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879297:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879304:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879311:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856817.879315:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879324:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879337:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856817.879340:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856817.879345:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879351:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4103 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879365:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879372:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879378:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879383:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856817.879391:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879398:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879406:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065c3c5f300) 00010000:00010000:1.0:1787856817.879407:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856817.879410:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879416:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c410a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879453:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c40fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 23 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879466:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 22 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.879472:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:1.0:1787856817.879475:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856817.879477:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939000, rc 0) 00000100:00100000:1.0:1787856817.879527:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+22:11316:x1874703426834688:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 730us (941us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787856817.879535:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:0.0:1787856817.885550:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856817.885638:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426834816 00000100:00100000:3.0:1787856817.885649:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426834816 00000100:00100000:3.0:1787856817.885708:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:3.0:1787856817.885719:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+22:11316:x1874703426834816:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1787856817.885786:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885803:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885815:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885850:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885870:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885886:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885892:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856817.885908:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885917:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885928:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:3.0:1787856817.885931:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856817.885936:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.885942:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c411f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856817.886018:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+22:11316:x1874703426834816:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 300us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.886026:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:0.0:1787856817.889634:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856817.889726:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426835072 00000100:00100000:2.0:1787856817.889736:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426835072 00000100:00100000:2.0:1787856817.889806:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1787856817.889817:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0395050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+22:11316:x1874703426835072:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787856817.890058:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0395050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+23:11316:x1874703426835072:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 242us (432us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787856817.890066:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1787856817.924188:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856817.924423:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426835328 00000100:00100000:0.0:1787856817.924436:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426835328 00000100:00100000:0.0:1787856817.924508:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:0.0:1787856817.924519:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601989680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+23:10834:x1874703426835328:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856817.924545:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856817.924567:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4126 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6022 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.924675:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.924690:0:9124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 24 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.924698:0:9124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.924729:0:9124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 24 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.924743:0:9124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 24 pid: 8909 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856817.924777:0:9124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8387480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436354816:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856817.925034:0:9124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760000 going to sleep for 11 seconds 00000100:00100000:1.0:1787856817.928522:0:9124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8387480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436354816:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856817.928551:0:9124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856817.928683:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856817.929367:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426835456 00000100:00100000:3.0:1787856817.929374:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426835456 00010000:00010000:3.0:1787856817.929410:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 25 pid: 8909 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856817.929483:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1787856817.929491:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+25:2402:x1874703426835456:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856817.929506:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856817.929513:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 25 pid: 8909 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.929525:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 25 pid: 8909 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.929562:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4111 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a601b expref: 25 pid: 8909 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.929578:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:3.0:1787856817.929583:0:13166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.929592:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.929599:0:13166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.929628:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787856817.929775:0:9124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.929783:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856817.929804:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787856817.929955:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4126 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 26 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.929971:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 25 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.929978:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:1.0:1787856817.929981:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787856817.929983:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbe00, rc 0) 00000100:00100000:3.0:1787856817.930310:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+25:2402:x1874703426835456:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 818us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.930318:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1787856817.931029:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601989680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+24:10834:x1874703426835328:12345-192.168.202.6@tcp:101:bash.0 Request processed in 6508us (6848us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1787856817.931038:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:0.0:1787856817.934370:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856817.934463:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426835584 00000100:00100000:3.0:1787856817.934472:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426835584 00000100:00100000:3.0:1787856817.934566:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:3.0:1787856817.934576:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:10834:x1874703426835584:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1787856817.934602:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856817.934624:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c413b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6029 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.934656:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c4142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.934683:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c4142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.934696:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c4142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.935054:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c413b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6029 expref: 26 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.935073:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c4142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6029 expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856817.935082:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:3.0:1787856817.935085:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787856817.935160:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fec00, rc 0) 00000100:00100000:3.0:1787856817.935338:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+25:10834:x1874703426835584:12345-192.168.202.6@tcp:101:bash.0 Request processed in 762us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856817.935346:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:2.0:1787856817.938807:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856817.939017:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426835840 00000100:00100000:0.0:1787856817.939026:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426835840 00000100:00100000:0.0:1787856817.939182:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:0.0:1787856817.939193:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+25:10834:x1874703426835840:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:0.0:1787856817.939586:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.939603:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.939615:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787856817.939657:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1787856817.939680:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5f23b45 reply state 00000000b1d0912a transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.939692:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856817.939700:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:0.0:1787856817.939703:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856817.939706:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787856817.939744:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1787856817.939963:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+29:10834:x1874703426835840:12345-192.168.202.6@tcp:36:bash.0 Request processed in 770us (1164us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787856817.939971:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 100 00000020:00080000:0.0:1787856817.939976:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787856817.942305:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856817.942387:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426835968 00000100:00100000:1.0:1787856817.942396:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426835968 00000100:00100000:1.0:1787856817.942451:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:1.0:1787856817.942459:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+29:10834:x1874703426835968:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787856817.942479:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856817.942495:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4150 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6030 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.942570:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4150 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6030 expref: 30 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.942584:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4150 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6030 expref: 30 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856817.942602:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:1.0:1787856817.942605:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856817.942608:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938400, rc 0) 00000100:00100000:1.0:1787856817.942663:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+30:10834:x1874703426835968:12345-192.168.202.6@tcp:101:bash.0 Request processed in 204us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856817.942669:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:3.0:1787856817.945745:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856817.945848:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426836096 00000100:00100000:2.0:1787856817.945867:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426836096 00000100:00100000:2.0:1787856817.945982:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:2.0:1787856817.945992:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:10834:x1874703426836096:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856817.946009:0:10490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856817.946028:0:10490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6037 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856817.946051:0:10490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9087ad, atime: 0x6a9087ac, ctime: 0x6a9087ad, blocks: 0x8 00010000:00010000:2.0:1787856817.946072:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1787856817.946077:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856817.946084:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 7 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856817.946113:0:10490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 7 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856817.946143:0:10490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a200, rc 0) 00000100:00100000:2.0:1787856817.946198:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:10834:x1874703426836096:12345-192.168.202.6@tcp:101:bash.0 Request processed in 208us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856817.946205:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1787856817.948394:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856817.948615:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426836224 00000100:00100000:1.0:1787856817.948624:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426836224 00002000:00010000:1.0:1787856817.948662:0:8413:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1787856817.948667:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c8360b40 with x1874703426836224 ext(0->18446744073709551615) 00002000:00010000:1.0:1787856817.948678:0:8413:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9064c8360b40. 00000100:00100000:1.0:1787856817.948712:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1787856817.948723:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426836224:12345-192.168.202.6@tcp:10:bash.0 00002000:00010000:1.0:1787856817.948997:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787856817.949001:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787856813 -> 1787856817 00002000:00010000:1.0:1787856817.949003:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787856812 -> 1787856812 00002000:00010000:1.0:1787856817.949006:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787856813 -> 1787856817 00002000:00010000:1.0:1787856817.949008:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787856817.949122:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426836224:12345-192.168.202.6@tcp:10:bash.0 Request processed in 401us (735us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787856817.949139:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00002000:00010000:1.0:1787856817.949143:0:8413:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1787856817.949146:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c8360b40 with x1874703426836224 ext(0->18446744073709551615) 00002000:00010000:1.0:1787856817.949151:0:8413:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9064c8360b40. 00000001:00080000:1.0:1787856818.004252:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787856818.004350:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1787856818.015831:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856818.015895:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426836352 00000100:00100000:3.0:1787856818.015906:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426836352 00000100:00100000:3.0:1787856818.016021:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:3.0:1787856818.016031:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+30:11330:x1874703426836352:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1787856818.016114:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.016131:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.016151:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.016167:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.016174:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.016181:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.016305:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.016315:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.016321:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856818.016747:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016771:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016777:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016783:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016789:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.016793:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016800:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016813:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856818.016815:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.016821:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016827:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c415e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016851:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016868:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016883:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016888:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.016891:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016897:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016904:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065d3599b00) 00010000:00010000:2.0:1787856818.016906:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.016909:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016914:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016929:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016934:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016939:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016949:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fee00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.016952:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016958:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016967:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:2.0:1787856818.016969:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.016972:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.016978:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c416c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856818.017068:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+30:11330:x1874703426836352:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 1037us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856818.017078:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 102 00010000:00010000:0.0:1787856818.066006:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856818.068118:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856818.068356:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426836608 00000100:00100000:3.0:1787856818.068366:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426836608 00000100:00100000:2.0:1787856818.068512:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:2.0:1787856818.068523:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+30:11333:x1874703426836608:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856818.068546:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856818.068696:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4173 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a603e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068763:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068777:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068803:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068815:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068820:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068824:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068938:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4188 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068945:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.068950:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856818.068957:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787856818.069022:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069027:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069031:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069035:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.069043:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069049:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069058:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856818.069060:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.069063:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069067:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c417a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069076:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069080:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069083:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069087:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.069090:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069095:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069102:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:2.0:1787856818.069104:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.069112:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069118:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4181 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069156:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4173 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a603e expref: 33 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069165:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a603e expref: 32 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.069171:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:2.0:1787856818.069172:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787856818.069174:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b200, rc 0) 00000100:00100000:2.0:1787856818.069303:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+32:11333:x1874703426836608:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 782us (1194us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787856818.069309:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:3.0:1787856818.071823:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.071956:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426836736 00000100:00100000:0.0:1787856818.071965:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426836736 00000100:00100000:0.0:1787856818.072025:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:0.0:1787856818.072035:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+32:11333:x1874703426836736:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:0.0:1787856818.072099:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.072114:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 32 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.072125:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.072158:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 32 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.072171:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 32 pid: 9124 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.072185:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436354944:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856818.072522:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856818.074514:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436354944:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856818.074540:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.077634:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.078177:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426836992 00000100:00100000:2.0:1787856818.078187:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426836992 00000100:00100000:2.0:1787856818.078376:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1787856818.078387:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+33:6172:x1874703426836992:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787856818.078671:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+34:6172:x1874703426836992:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 287us (1047us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787856818.078677:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:0.0:1787856818.080386:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.080479:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426837120 00000100:00100000:2.0:1787856818.080486:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426837120 00010000:00010000:2.0:1787856818.080517:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 34 pid: 9124 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856818.080570:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1787856818.080580:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+34:2401:x1874703426837120:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856818.080594:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856818.080601:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 34 pid: 9124 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.080613:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 34 pid: 9124 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.080635:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c412d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6022 expref: 34 pid: 9124 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.080651:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:2.0:1787856818.080656:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.080666:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.080672:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.080697:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856818.080722:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.080736:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.080773:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.080781:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.080787:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.080793:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bac00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856818.080797:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.080804:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.080814:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:3.0:1787856818.080817:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856818.080820:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.080826:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4196 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.080890:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+33:11333:x1874703426836736:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 8856us (9080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856818.080890:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+33:2401:x1874703426837120:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 310us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856818.080898:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:2.0:1787856818.080898:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1787856818.084042:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856818.084108:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426837376 00000100:00100000:3.0:1787856818.084116:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426837376 00000100:00100000:3.0:1787856818.084160:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1787856818.084169:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+32:11333:x1874703426837376:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856818.084399:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+33:11333:x1874703426837376:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 231us (364us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787856818.084404:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:0.0:1787856818.182267:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.182441:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426837632 00000100:00100000:2.0:1787856818.182464:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426837632 00000100:00100000:2.0:1787856818.182532:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:2.0:1787856818.182542:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+33:11344:x1874703426837632:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:2.0:1787856818.182574:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856818.182597:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c419d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6045 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182670:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182684:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182695:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182709:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182715:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182720:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182836:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c41b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182846:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c41b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182853:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c41b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856818.182883:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787856818.182965:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182973:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182979:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182985:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.182989:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.182996:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183009:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856818.183013:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.183017:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183023:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183035:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183042:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183058:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183062:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.183065:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183071:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183085:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:2.0:1787856818.183096:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.183099:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183105:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183150:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c419d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6045 expref: 36 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183164:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c41b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6045 expref: 35 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.183170:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:2.0:1787856818.183172:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856818.183175:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215bc00, rc 0) 00000100:00100000:2.0:1787856818.183281:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+35:11344:x1874703426837632:12345-192.168.202.6@tcp:101:cat.0 Request processed in 741us (1065us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787856818.183299:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:0.0:1787856818.188863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.189010:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426837888 00000100:00100000:2.0:1787856818.189019:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426837888 00000100:00100000:2.0:1787856818.189067:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:2.0:1787856818.189074:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+35:11344:x1874703426837888:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:2.0:1787856818.189345:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+36:11344:x1874703426837888:12345-192.168.202.6@tcp:35:cat.0 Request processed in 271us (507us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787856818.189350:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:0.0:1787856818.210972:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.211169:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426838144 00000100:00100000:2.0:1787856818.211179:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426838144 00000100:00100000:2.0:1787856818.211266:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:2.0:1787856818.211329:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+36:11345:x1874703426838144:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:2.0:1787856818.211385:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787856818.211407:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4150 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6030 expref: 36 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211421:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c41b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6045 expref: 35 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211429:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a603e expref: 34 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211436:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c4142 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6029 expref: 33 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211443:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:2.0:1787856818.211460:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856818.211479:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211489:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211496:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211506:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211511:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211514:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211585:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211593:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211599:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856818.211813:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787856818.211823:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351921604919ns, next at 352921602396ns, rc = 0 00010000:00010000:2.0:1787856818.211929:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211943:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211948:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211953:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211957:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.211961:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.212951:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787856818.212979:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.212988:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.212994:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213001:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.213005:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213013:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213043:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:2.0:1787856818.213046:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787856818.213051:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213057:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c41ce lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213078:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213084:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213170:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213175:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215be00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.213178:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213185:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213194:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856818.213197:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.213200:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213206:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c41c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856818.213258:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da3d175a reply state 00000000f08d139c transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213269:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.213275:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:2.0:1787856818.213277:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787856818.213280:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856818.213368:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+34:11345:x1874703426838144:12345-192.168.202.6@tcp:36:rm.0 Request processed in 2091us (2403us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787856818.213377:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 106 00010000:00010000:3.0:1787856818.213458:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856818.213465:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.213471:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856818.213474:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.213479:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.213489:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:3.0:1787856818.213491:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787856818.213493:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.213498:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c41d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.213507:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856818.213509:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856818.213511:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856818.290133:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856818.290212:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426838400 00000100:00100000:3.0:1787856818.290254:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426838400 00000100:00100000:3.0:1787856818.290305:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:3.0:1787856818.290315:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+34:11351:x1874703426838400:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1787856818.290340:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856818.290377:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c41dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a604c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.290461:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.290483:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.290492:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.290501:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.290506:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.290509:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787856818.291003:0:6498:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787856818.291113:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291123:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291141:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291172:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291177:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291181:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291184:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856818.291187:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291192:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291200:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:3.0:1787856818.291202:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856818.291206:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291210:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c41e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787856818.291239:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008237e27e reply state 0000000033b02345 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291248:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291257:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:3.0:1787856818.291259:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787856818.291261:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787856818.291282:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c41dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291292:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 36 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.291297:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065d3599300) 00010000:00010000:3.0:1787856818.291298:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787856818.291300:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fee00, rc 0) 00000100:00100000:3.0:1787856818.291393:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+37:11351:x1874703426838400:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1079us (1272us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787856818.291398:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:0.0:1787856818.297266:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.297333:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426838528 00000100:00100000:2.0:1787856818.297341:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426838528 00000100:00100000:2.0:1787856818.297419:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:2.0:1787856818.297427:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426838528:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856818.297446:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856818.297471:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6053 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856818.297496:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787856818.297515:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1787856818.297520:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856818.297529:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 6 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.297550:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 6 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.297580:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215be00, rc 0) 00000100:00100000:2.0:1787856818.297652:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426838528:12345-192.168.202.6@tcp:101:bash.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856818.297659:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:0.0:1787856818.300779:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856818.300935:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426838656 00000100:00100000:1.0:1787856818.300945:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426838656 00000100:00100000:1.0:1787856818.301003:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:1.0:1787856818.301012:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:11351:x1874703426838656:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787856818.301030:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856818.301049:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a605a expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.301079:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.301200:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856818.301204:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856818.301211:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.301269:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.301283:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 7 pid: 8409 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856818.301311:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1874703436355072:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856818.301440:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856818.305112:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856818.305631:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426838784 00000100:00100000:3.0:1787856818.305643:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426838784 00010000:00010000:3.0:1787856818.305685:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 8 pid: 8409 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.305736:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:3.0:1787856818.305746:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2401:x1874703426838784:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856818.305771:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856818.305796:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 8 pid: 8409 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.305829:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 8 pid: 8409 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.305882:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856818.305887:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856818.305895:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.305906:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.305942:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.305956:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8362580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6482:1874703436355200:192.168.202.6@tcp:105: 00000100:00100000:3.0:1787856818.306044:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787856818.308643:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8362580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6482:1874703436355200:192.168.202.6@tcp:105: 00010000:00010000:3.0:1787856818.308666:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856818.308715:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2401:x1874703426838784:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 2971us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856818.308725:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00010000:00010000:1.0:1787856818.309965:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c41ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6053 expref: 7 pid: 8409 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856818.309986:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1874703436355072:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856818.310011:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 6 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.310025:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939800, rc 0) 00000100:00100000:1.0:1787856818.310076:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:11351:x1874703426838656:12345-192.168.202.6@tcp:101:bash.0 Request processed in 9064us (9306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856818.310093:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:0.0:1787856818.313804:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.313963:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426839040 00000100:00100000:2.0:1787856818.313974:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426839040 00000100:00100000:2.0:1787856818.314065:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:2.0:1787856818.314075:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+37:11351:x1874703426839040:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1787856818.314580:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+38:11351:x1874703426839040:12345-192.168.202.6@tcp:35:bash.0 Request processed in 505us (784us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787856818.314590:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1787856818.497101:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856818.497259:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426839168 00000100:00100000:1.0:1787856818.497269:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426839168 00000100:00100000:1.0:1787856818.497334:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:1.0:1787856818.497344:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+38:11367:x1874703426839168:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856818.497368:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856818.497387:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c420d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6061 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.497445:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4214 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.497475:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.497487:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856818.497530:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787856818.497534:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856818.497553:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.497577:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c420d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6061 expref: 40 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.497594:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6061 expref: 39 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.497603:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856818.497606:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856818.497610:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938000, rc 0) 00000100:00100000:1.0:1787856818.497672:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+39:11367:x1874703426839168:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 329us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856818.497679:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:0.0:1787856818.503022:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.503142:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426839424 00000100:00100000:2.0:1787856818.503152:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426839424 00000100:00100000:2.0:1787856818.503213:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:2.0:1787856818.503261:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+39:11367:x1874703426839424:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856818.503280:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856818.503300:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c421b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6068 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.503405:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4222 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.503419:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.503431:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856818.503457:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787856818.503562:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c421b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6068 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.503579:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6068 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.503587:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065d3599300) 00010000:00010000:2.0:1787856818.503590:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856818.503593:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b200, rc 0) 00000100:00100000:2.0:1787856818.503647:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+41:11367:x1874703426839424:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 388us (637us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787856818.503654:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:3.0:1787856818.508649:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.508752:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426839680 00000100:00100000:0.0:1787856818.508764:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426839680 00000100:00100000:0.0:1787856818.508825:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:0.0:1787856818.508836:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+41:11367:x1874703426839680:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856818.508878:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856818.508898:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4230 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a606f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.509000:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4237 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.509015:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.509027:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856818.509038:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787856818.509175:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4230 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a606f expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.509193:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4237 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a606f expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.509202:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065d3599300) 00010000:00010000:0.0:1787856818.509205:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787856818.509208:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007baa00, rc 0) 00000100:00100000:0.0:1787856818.509732:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+43:11367:x1874703426839680:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 895us (1090us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787856818.509742:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:0.0:1787856818.512923:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856818.513040:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426839808 00000100:00100000:3.0:1787856818.513049:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426839808 00000100:00100000:3.0:1787856818.513136:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1787856818.513147:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+43:2402:x1874703426839808:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856818.513162:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856818.513188:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4222 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6068 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.513208:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065d3599300) 00010000:00010000:3.0:1787856818.513212:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856818.513312:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+42:2402:x1874703426839808:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 167us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856818.513320:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1787856818.520512:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.520628:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426839936 00000100:00100000:2.0:1787856818.520638:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426839936 00000100:00100000:2.0:1787856818.520697:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1787856818.520706:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426839936:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:2.0:1787856818.520753:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.520772:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 6 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.520781:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856818.520785:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787856818.520791:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.520840:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 6 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.520875:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 6 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856818.520890:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066019892c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1874703436355328:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856818.520982:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe90ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856818.524525:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066019892c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1874703436355328:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856818.524558:0:8407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.526502:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.526798:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426840064 00000100:00100000:2.0:1787856818.526808:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426840064 00002000:00100000:2.0:1787856818.526879:0:8415:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9064c8363c00 x1874703426840064/t0(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:219/0 lens 504/0 e 0 to 0 dl 1787856829 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787856818.526890:0:8415:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c8363c00 with x1874703426840064 ext(0->8) 00010000:00010000:2.0:1787856818.526898:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 7 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.526913:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 7 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856818.526920:0:8415:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9064c8363c00 00000100:00100000:2.0:1787856818.526974:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:2.0:1787856818.526984:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426840064:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:2.0:1787856818.529294:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:898e91b3-529b-44bc-a821-726bff6c71d4+9:2402:x1874703426840064:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 2302us (2791us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787856818.529308:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00002000:00100000:2.0:1787856818.529319:0:8415:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9064c8363c00 x1874703426840064/t4294967303(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:219/0 lens 504/448 e 0 to 0 dl 1787856829 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787856818.529328:0:8415:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c8363c00 with x1874703426840064 ext(0->8) 00010000:00010000:2.0:1787856818.529339:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 9 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.529357:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 9 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856818.529364:0:8415:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9064c8363c00 00000100:00100000:1.0:1787856818.532490:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.532608:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426840192 00000100:00100000:0.0:1787856818.532619:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426840192 00010000:00010000:0.0:1787856818.532661:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 9 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.532770:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:0.0:1787856818.532782:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+9:2400:x1874703426840192:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856818.532798:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787856818.532816:0:6481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787856818.532819:0:6481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787856818 00002000:00010000:0.0:1787856818.532821:0:6481:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787856818 00002000:00010000:0.0:1787856818.532824:0:6481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787856818 00002000:00010000:0.0:1787856818.532826:0:6481:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787856818.532832:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 9 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.533012:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 9 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.533037:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000410f4f08/0xc25410d92a3c4206 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a605a expref: 9 pid: 8410 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.533054:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856818.533058:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856818.533065:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.533074:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.533168:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856818.533282:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+8:2400:x1874703426840192:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 501us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.533290:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00010000:00010000:3.0:1787856818.534834:0:8407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.534923:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.534954:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.534963:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.534972:0:8407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.535001:0:8407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856818.535005:0:8407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.535014:0:8407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.535033:0:8407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.535042:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d615ea44/0xc25410d92a3c4245 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.535279:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426839936:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 14569us (14772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856818.535289:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:1.0:1787856818.538359:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856818.538634:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426840448 00000100:00100000:3.0:1787856818.538644:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426840448 00000100:00100000:3.0:1787856818.538742:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:3.0:1787856818.538831:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0393450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+42:11367:x1874703426840448:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:3.0:1787856818.538970:0:6499:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4237 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a606f expref: 42 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787856818.539358:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1787856818.539397:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787856818.540023:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1787856818.540067:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.540159:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 46 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.540171:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.540207:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 46 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856818.540355:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 46 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.540371:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8361e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1874703436355456:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856818.540585:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856818.545117:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.545623:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8361e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1874703436355456:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856818.545651:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.546067:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426840576 00000100:00100000:3.0:1787856818.546074:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426840576 00010000:00010000:0.0:1787856818.546403:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 47 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.546444:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1787856818.546454:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+47:2401:x1874703426840576:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856818.546470:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856818.546477:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 47 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.546506:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 47 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.546530:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c41f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a604c expref: 47 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.546547:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065d3599300) 00010000:00010000:0.0:1787856818.546552:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.546561:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.546568:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.546602:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856818.546653:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+46:2401:x1874703426840576:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 200us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.546660:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00010000:00010000:1.0:1787856818.546768:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.546787:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856818.547154:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787856818.547324:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787856818.547437:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436355584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787856818.547496:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856818.547529:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787856818.548350:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436355584 00000100:00100000:0.0:1787856818.548359:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436355584 00000100:00100000:0.0:1787856818.548420:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787856818.548430:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436355584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787856818.548538:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436355584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.548546:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787856818.549389:0:6499:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1787856818.549400:0:6499:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1787856818.549426:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9065c60e6580, transno 4294967302 00000100:00100000:1.0:1787856818.549446:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436355584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787856818.549598:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1787856818.549674:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436355712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787856818.549721:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856818.549745:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856818.550185:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436355712 00000100:00100000:0.0:1787856818.550192:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436355712 00000100:00100000:0.0:1787856818.550261:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787856818.550272:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436355712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787856818.550402:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6499:x1874703436355712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 132us (680us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787856818.550409:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787856818.550448:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436355712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787856818.550494:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1787856818.550527:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.550538:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.550545:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.550551:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856818.550555:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.550563:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.550578:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065d3599300) 00010000:00010000:0.0:1787856818.550581:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787856818.550586:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.550592:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c424c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787856818.550695:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787856818.550746:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787856818.550771:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352260553114ns, next at 353260550648ns, rc = 0 00000001:00080000:0.0:1787856818.550778:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1787856818.550800:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065d3599300) 00010000:00010000:0.0:1787856818.550803:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787856818.550810:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4237 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a606f expref: 50 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.551210:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0393450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+49:11367:x1874703426840448:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 12457us (12857us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787856818.551240:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000020:00080000:0.0:1787856818.551244:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1787856818.551537:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856818.554578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.554642:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426840704 00000100:00100000:0.0:1787856818.554651:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426840704 00000100:00100000:0.0:1787856818.554750:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:0.0:1787856818.554761:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+49:11367:x1874703426840704:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856818.554784:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856818.554805:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4253 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6076 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.554881:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4253 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6076 expref: 50 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.554896:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4253 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6076 expref: 50 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.554934:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856818.554937:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787856818.554940:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bac00, rc 0) 00000100:00100000:0.0:1787856818.554997:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+50:11367:x1874703426840704:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 238us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.555004:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:3.0:1787856818.558380:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.558654:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426840960 00000100:00100000:2.0:1787856818.558664:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426840960 00000100:00100000:2.0:1787856818.558724:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:2.0:1787856818.558733:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+50:11367:x1874703426840960:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787856818.558995:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+51:11367:x1874703426840960:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 262us (625us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787856818.559017:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:1.0:1787856818.665121:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.665274:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426841088 00000100:00100000:2.0:1787856818.665285:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426841088 00000100:00100000:2.0:1787856818.665345:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:2.0:1787856818.665356:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+51:11377:x1874703426841088:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1787856818.665436:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665449:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665457:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665466:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665471:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665475:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665539:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665547:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665553:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856818.665618:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665632:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665639:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665645:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665651:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215bc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.665655:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665663:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665676:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856818.665678:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.665683:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665689:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c425a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665702:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665707:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665719:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665725:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.665729:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665735:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665742:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:2.0:1787856818.665744:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.665747:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665753:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4261 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665762:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665768:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665773:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665777:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856818.665780:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665796:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665804:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:2.0:1787856818.665807:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856818.665810:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.665816:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856818.665903:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+51:11377:x1874703426841088:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 548us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856818.665911:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:3.0:1787856818.703297:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.703396:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426841344 00000100:00100000:0.0:1787856818.703406:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426841344 00000100:00100000:0.0:1787856818.703473:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:0.0:1787856818.703483:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+51:11380:x1874703426841344:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856818.703503:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856818.703524:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c426f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a607d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703594:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703608:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703620:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703631:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703639:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703666:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703792:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703801:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703808:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856818.703817:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787856818.703913:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703921:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703927:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703932:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbe00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856818.703936:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703944:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703956:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:0.0:1787856818.703959:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856818.703971:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703978:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4276 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703991:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.703998:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.704003:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.704009:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856818.704012:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.704018:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.704025:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:0.0:1787856818.704027:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856818.704031:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.704037:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c427d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.704075:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c426f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 54 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.704100:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.704108:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856818.704110:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856818.704112:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbc00, rc 0) 00000100:00100000:0.0:1787856818.704298:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+53:11380:x1874703426841344:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 817us (1009us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787856818.704306:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:3.0:1787856818.707928:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.708195:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426841472 00000100:00100000:0.0:1787856818.708203:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426841472 00000100:00100000:0.0:1787856818.708283:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:0.0:1787856818.708293:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+53:11380:x1874703426841472:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:0.0:1787856818.708361:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.708375:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.708384:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.708414:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.708424:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.708446:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.708450:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bba00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856818.708454:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.708459:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.711228:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856818.711237:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787856818.711243:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.711252:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4292 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.711353:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+53:11380:x1874703426841472:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 3053us (3425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.711362:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:1.0:1787856818.714402:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.714493:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426841728 00000100:00100000:2.0:1787856818.714504:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426841728 00000100:00100000:2.0:1787856818.714563:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:2.0:1787856818.714573:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+53:11380:x1874703426841728:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787856818.714904:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+54:11380:x1874703426841728:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 331us (510us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787856818.714911:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:3.0:1787856818.806043:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856818.806194:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426841984 00000100:00100000:1.0:1787856818.806204:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426841984 00000100:00100000:1.0:1787856818.806372:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:1.0:1787856818.806383:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+54:11390:x1874703426841984:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787856818.806410:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856818.806414:0:9124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787856818.806441:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4214 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6061 expref: 54 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.806474:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856818.806479:0:9124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787856818.806492:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4299 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6084 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.806598:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.806613:0:9124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 54 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.806621:0:9124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.806652:0:9124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 54 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.806666:0:9124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 54 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856818.806679:0:9124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436355840:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856818.806782:0:9124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856818.809559:0:9124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436355840:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856818.809589:0:9124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.814410:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.814946:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426842112 00000100:00100000:0.0:1787856818.814955:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426842112 00010000:00010000:0.0:1787856818.814997:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 55 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.815053:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:0.0:1787856818.815062:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+55:2401:x1874703426842112:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856818.815076:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856818.815082:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 55 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.815096:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 55 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.815121:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4284 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a607d expref: 55 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.815135:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856818.815141:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.815150:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.815158:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.815192:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787856818.815345:0:9124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.815353:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856818.815380:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787856818.815502:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4299 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 56 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.815517:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 55 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.815523:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856818.815526:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787856818.815528:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938a00, rc 0) 00000100:00100000:0.0:1787856818.815818:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+55:2401:x1874703426842112:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 756us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.815828:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1787856818.817363:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+54:11390:x1874703426841984:12345-192.168.202.6@tcp:101:bash.0 Request processed in 10973us (11321us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787856818.817374:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:3.0:1787856818.820635:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.820702:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426842240 00000100:00100000:2.0:1787856818.820712:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426842240 00000100:00100000:2.0:1787856818.820786:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:2.0:1787856818.820796:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+54:11390:x1874703426842240:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856818.820820:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856818.820840:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c42ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a608b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.820909:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.820924:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.820935:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.821046:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c42ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 56 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.821065:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 55 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.821074:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:2.0:1787856818.821077:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787856818.821093:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215bc00, rc 0) 00000100:00100000:2.0:1787856818.821608:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+55:11390:x1874703426842240:12345-192.168.202.6@tcp:101:bash.0 Request processed in 811us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856818.821617:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:3.0:1787856818.825142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856818.825678:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426842496 00000100:00100000:1.0:1787856818.825688:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426842496 00000100:00100000:1.0:1787856818.825790:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:1.0:1787856818.825801:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+55:11390:x1874703426842496:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:1.0:1787856818.826051:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.826069:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.826212:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856818.826365:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1787856818.826409:0:8909:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075b79b15 reply state 00000000aaf4edfe transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.826422:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.826430:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856818.826433:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787856818.826437:0:8909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787856818.826582:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+58:11390:x1874703426842496:12345-192.168.202.6@tcp:36:bash.0 Request processed in 783us (1502us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787856818.826590:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000020:00080000:1.0:1787856818.826595:0:8909:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787856818.829777:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.829875:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426842624 00000100:00100000:0.0:1787856818.829897:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426842624 00000100:00100000:0.0:1787856818.829956:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:0.0:1787856818.829966:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+58:11390:x1874703426842624:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856818.829990:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856818.830011:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c42c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6092 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.830129:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.830145:0:9124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 59 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.830153:0:9124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.830186:0:9124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 59 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.830200:0:9124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 59 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.830214:0:9124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436355968:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856818.830323:0:9124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb7609c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856818.833318:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.833419:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426842752 00000100:00100000:2.0:1787856818.833428:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426842752 00010000:00010000:2.0:1787856818.833468:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 60 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856818.833509:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:2.0:1787856818.833519:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+60:2402:x1874703426842752:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856818.833549:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856818.833556:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 60 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.833569:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 60 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.833594:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:2.0:1787856818.833599:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.833608:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.833616:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.833635:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856818.833694:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+60:2402:x1874703426842752:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 176us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856818.833702:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00010000:00010000:0.0:1787856818.835174:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c42a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6084 expref: 59 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.835195:0:9124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436355968:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856818.835395:0:9124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.835406:0:9124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.835413:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856818.835461:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787856818.835466:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856818.835486:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.835519:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c42c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 59 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.835534:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 58 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.835541:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856818.835544:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856818.835547:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bba00, rc 0) 00000100:00100000:0.0:1787856818.835607:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+58:11390:x1874703426842624:12345-192.168.202.6@tcp:101:bash.0 Request processed in 5642us (5838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.835615:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:3.0:1787856818.839919:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856818.840012:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426843008 00000100:00100000:1.0:1787856818.840022:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426843008 00000100:00100000:1.0:1787856818.840086:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:1.0:1787856818.840095:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+58:11390:x1874703426843008:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:1.0:1787856818.840343:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+59:11390:x1874703426843008:12345-192.168.202.6@tcp:35:bash.0 Request processed in 249us (433us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1787856818.840351:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:3.0:1787856818.910735:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.910889:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426843136 00000100:00100000:2.0:1787856818.910899:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426843136 00000100:00100000:2.0:1787856818.910958:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:2.0:1787856818.910968:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+59:11396:x1874703426843136:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856818.910991:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856818.911010:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c42d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6099 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.911099:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c42d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.911114:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c42d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.911126:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c42d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856818.911169:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787856818.911173:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856818.911193:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c42d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.911249:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c42d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6099 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.911267:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c42d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6099 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.911276:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:2.0:1787856818.911279:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856818.911283:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215be00, rc 0) 00000100:00100000:2.0:1787856818.911350:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+60:11396:x1874703426843136:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 385us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856818.911357:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:3.0:1787856818.919392:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856818.919493:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426843264 00000100:00100000:1.0:1787856818.919501:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426843264 00000100:00100000:1.0:1787856818.919555:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:1.0:1787856818.919564:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+60:11396:x1874703426843264:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856818.919588:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856818.919610:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c42df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60a0 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919686:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919697:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919705:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919712:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919717:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919721:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919791:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c42f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919797:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c42f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919801:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c42f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856818.919831:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787856818.919834:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856818.919855:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c42f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919884:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c42f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919893:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919904:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919911:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919918:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856818.919922:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919930:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919941:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856818.919944:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856818.919948:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919955:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c42e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919969:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919974:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919986:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.919992:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856818.919994:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.920001:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.920015:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:1.0:1787856818.920017:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856818.920020:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.920025:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c42ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.920052:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c42df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a0 expref: 62 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.920063:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c42f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a0 expref: 61 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.920068:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856818.920069:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856818.920071:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939000, rc 0) 00000100:00100000:1.0:1787856818.920129:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+61:11396:x1874703426843264:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 567us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856818.920142:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:3.0:1787856818.923854:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.923964:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426843392 00000100:00100000:0.0:1787856818.923973:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426843392 00000100:00100000:0.0:1787856818.924041:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:0.0:1787856818.924050:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+61:2402:x1874703426843392:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856818.924081:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856818.924106:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c42f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a0 expref: 61 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.924125:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856818.924130:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856818.924187:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+60:2402:x1874703426843392:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.924195:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1787856818.925893:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.926400:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426843648 00000100:00100000:0.0:1787856818.926408:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426843648 00000100:00100000:0.0:1787856818.926517:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:0.0:1787856818.926527:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+60:11396:x1874703426843648:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856818.926546:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856818.926565:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c42fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60a7 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.926672:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.926687:0:9124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 61 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.926695:0:9124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.926726:0:9124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 61 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.926773:0:9124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 61 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.926788:0:9124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436356096:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856818.926897:0:9124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb7609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856818.929418:0:9124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436356096:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856818.929444:0:9124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856818.933740:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.933821:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426843776 00000100:00100000:0.0:1787856818.933829:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426843776 00010000:00010000:0.0:1787856818.933897:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 62 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856818.933933:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:0.0:1787856818.933942:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+62:2400:x1874703426843776:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856818.933955:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856818.933961:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 62 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.933974:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 62 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.933995:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c42ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6092 expref: 62 pid: 9124 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.934028:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856818.934033:0:13166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.934042:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.934049:0:13166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.934079:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856818.934140:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+61:2400:x1874703426843776:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 199us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.934147:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00010000:00010000:1.0:1787856818.935411:0:9124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.935423:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856818.935441:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787856818.935577:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c42fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 62 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.935594:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 61 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.935601:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856818.935604:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787856818.935607:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007baa00, rc 0) 00000100:00100000:1.0:1787856818.935657:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+61:11396:x1874703426843648:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 9132us (9772us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787856818.935664:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:3.0:1787856818.939820:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856818.939927:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426844032 00000100:00100000:2.0:1787856818.939935:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426844032 00000100:00100000:2.0:1787856818.940001:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:2.0:1787856818.940008:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+61:11396:x1874703426844032:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:2.0:1787856818.940019:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856818.940041:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4253 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6076 expref: 61 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856818.940055:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:2.0:1787856818.940059:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856818.940106:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+60:11396:x1874703426844032:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856818.940111:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1787856818.942924:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856818.943106:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426844160 00000100:00100000:0.0:1787856818.943114:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426844160 00000100:00100000:0.0:1787856818.943318:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:0.0:1787856818.943329:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+60:11396:x1874703426844160:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:0.0:1787856818.943454:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.943471:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856818.943483:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787856818.943595:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787856818.943835:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+60:11396:x1874703426844160:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 507us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856818.943860:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:2.0:1787856818.946828:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856818.946977:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426844288 00000100:00100000:1.0:1787856818.946986:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426844288 00000100:00100000:1.0:1787856818.947049:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:1.0:1787856818.947059:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066019892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+60:11396:x1874703426844288:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856818.947077:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856818.947107:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60ae expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.947183:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.947194:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 61 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.947213:0:8909:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.947266:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 61 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.947280:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856818.947283:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856818.947287:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 61 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856818.947297:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938400, rc 0) 00000100:00100000:1.0:1787856818.947356:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066019892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+61:11396:x1874703426844288:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 299us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856818.947364:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00010000:00010000:0.0:1787856819.089455:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787856819.473479:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787856819.473489:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787856819.473984:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787856819.473994:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787856819.474258:0:13777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601988000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436356224:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787856819.474436:0:13777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe90e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856819.485005:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.485250:0:13777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601988000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436356224:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787856819.488005:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426844416 00000100:00100000:1.0:1787856819.488028:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426844416 00000100:00100000:1.0:1787856819.488145:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:1.0:1787856819.488157:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601989e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+61:11397:x1874703426844416:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787856819.488190:0:9124:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787856819.488352:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601989e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+61:11397:x1874703426844416:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 197us (3355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856819.488360:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00080000:3.0:1787856819.488810:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856819.499639:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.500301:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426844544 00000100:00100000:0.0:1787856819.500313:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426844544 00000100:00100000:0.0:1787856819.500389:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:0.0:1787856819.500400:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+61:11397:x1874703426844544:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787856819.501291:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501311:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501326:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501341:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501347:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501354:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501379:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501388:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501420:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856819.501763:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787856819.501768:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856819.501783:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501796:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501803:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501809:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501815:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbe00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856819.501820:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501829:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501922:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:0.0:1787856819.501926:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856819.501931:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501939:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c431e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501965:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501972:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501978:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501983:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856819.501986:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.501992:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502000:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9065c5b79100) 00010000:00010000:0.0:1787856819.502003:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856819.502006:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502012:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4325 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502027:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502033:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502038:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502051:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856819.502054:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502060:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502068:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856819.502070:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856819.502072:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.502077:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c432c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.502262:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+61:11397:x1874703426844544:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 1860us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.502272:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:0.0:1787856819.510379:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.511482:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426844800 00000100:00100000:2.0:1787856819.511495:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426844800 00000100:00100000:2.0:1787856819.511575:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:2.0:1787856819.511585:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+61:11397:x1874703426844800:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856819.511607:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856819.511627:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c4333 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60b5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.511761:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.511777:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.511789:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856819.511803:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787856819.512628:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512640:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512647:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512653:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856819.512658:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512666:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512679:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:2.0:1787856819.512682:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787856819.512686:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512705:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c433a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512748:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c4333 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60b5 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512758:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:2.0:1787856819.512760:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787856819.512763:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c4333 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60b5 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.512771:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ac00, rc 0) 00000100:00100000:2.0:1787856819.512902:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+62:11397:x1874703426844800:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1317us (2532us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787856819.512911:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:2.0:1787856819.527696:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.527766:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426844928 00000100:00100000:0.0:1787856819.527773:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426844928 00000100:00100000:0.0:1787856819.527822:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:0.0:1787856819.527832:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+62:11397:x1874703426844928:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787856819.527879:0:6497:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787856819.527996:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+62:11397:x1874703426844928:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 165us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.528004:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:3.0:1787856819.533235:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856819.534066:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426845184 00000100:00100000:1.0:1787856819.534079:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426845184 00000100:00100000:1.0:1787856819.534181:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:1.0:1787856819.534192:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+62:11397:x1874703426845184:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856819.534238:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856819.534242:0:8909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787856819.534281:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c42d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6099 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.534302:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856819.534307:0:8909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787856819.534320:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4348 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60bc expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787856819.534773:0:8909:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787856819.534978:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c434f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.534992:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c434f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.535002:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c434f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.535053:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4348 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60bc expref: 64 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.535085:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c434f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60bc expref: 63 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.535093:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7500) 00010000:00010000:1.0:1787856819.535096:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856819.535099:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939000, rc 0) 00000100:00100000:1.0:1787856819.535170:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+63:11397:x1874703426845184:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 980us (1959us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787856819.535178:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:1.0:1787856819.537552:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856819.537573:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436356352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856819.537636:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856819.537702:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436356352 00000100:00100000:1.0:1787856819.537709:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436356352 00000100:00100000:1.0:1787856819.537763:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787856819.537773:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436356352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856819.537794:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856819.537852:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436356352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856819.537873:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1787856819.537898:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856819.537930:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436356352:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1787856819.543778:0:9841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353253558121ns, next at 354253555028ns, rc = 0 00000100:00100000:1.0:1787856819.543807:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856819.543829:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436356480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856819.543934:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856819.544005:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436356480 00000100:00100000:1.0:1787856819.544014:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436356480 00000100:00100000:1.0:1787856819.544075:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787856819.544086:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436356480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856819.544116:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856819.544162:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436356480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856819.544170:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1787856819.544191:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787856819.544256:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436356480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856819.544566:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856819.544582:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436356608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856819.544613:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856819.546697:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436356608 00000100:00100000:2.0:1787856819.546711:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436356608 00000100:00100000:2.0:1787856819.546792:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787856819.546802:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436356608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856819.546825:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856819.546916:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436356608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856819.546923:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787856819.546977:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436356608:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787856819.547136:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787856819.547915:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856819.547927:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436356992:0@lo:400:kworker.0 00000100:00100000:1.0:1787856819.547975:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856819.548046:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436357120:0@lo:400:kworker.0 00000100:00100000:1.0:1787856819.548074:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856819.548124:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856819.548129:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436357504:0@lo:400:kworker.0 00000100:00100000:1.0:1787856819.548149:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856819.548181:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436357632:0@lo:400:kworker.0 00000100:00100000:1.0:1787856819.548200:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856819.548353:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436356864:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548382:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856819.548401:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436357376:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548434:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856819.548451:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436357888:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548471:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856819.548493:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787856819.548499:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436356736:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548527:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856819.548548:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436357248:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548570:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856819.548585:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436357760:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548606:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856819.548632:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436356736 00000100:00100000:0.0:1787856819.548637:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436356736 00000100:00100000:0.0:1787856819.548674:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787856819.548682:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436356736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548723:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436356736:12345-0@lo:400:kworker.0 Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.548729:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787856819.548761:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436356992 00000100:00100000:0.0:1787856819.548765:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436356992 00000100:00100000:0.0:1787856819.548780:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436357248 00000100:00100000:0.0:1787856819.548792:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436357248 00000100:00100000:0.0:1787856819.548812:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787856819.548817:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436356992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548871:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436356992:12345-0@lo:400:kworker.0 Request processed in 38us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.548877:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787856819.548889:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787856819.548895:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436357248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548924:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436357248:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.548930:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787856819.548963:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436356992:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548984:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436356736:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.548993:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436357248:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549015:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436357120 00000100:00100000:0.0:1787856819.549019:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436357120 00000100:00100000:0.0:1787856819.549038:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436357504 00000100:00100000:0.0:1787856819.549040:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436357504 00000100:00100000:0.0:1787856819.549060:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436357632 00000100:00100000:0.0:1787856819.549063:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436357632 00000100:00100000:0.0:1787856819.549074:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436356864 00000100:00100000:0.0:1787856819.549077:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436356864 00000100:00100000:0.0:1787856819.549087:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436357888 00000100:00100000:0.0:1787856819.549090:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436357888 00000100:00100000:0.0:1787856819.549101:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436357760 00000100:00100000:0.0:1787856819.549103:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436357760 00000100:00100000:0.0:1787856819.549117:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787856819.549122:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436357120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549158:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436357120:12345-0@lo:400:kworker.0 Request processed in 35us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.549164:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787856819.549176:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787856819.549181:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436357504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549201:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436357504:12345-0@lo:400:kworker.0 Request processed in 21us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.549206:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787856819.549235:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787856819.549241:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436357632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549278:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436357632:12345-0@lo:400:kworker.0 Request processed in 23us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.549285:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787856819.549295:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787856819.549300:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436356864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549329:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436356864:12345-0@lo:400:kworker.0 Request processed in 29us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.549334:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787856819.549344:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787856819.549349:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436357888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549370:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436357888:12345-0@lo:400:kworker.0 Request processed in 22us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.549375:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787856819.549385:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787856819.549389:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436357760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549418:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874703436357760:12345-0@lo:400:kworker.0 Request processed in 28us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.549422:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:0.0:1787856819.549438:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856819.549443:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787856819.549463:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a530c0 x1874703436357632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856819.549474:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436357632:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549484:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436357504:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549493:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436357120:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549518:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874703436357760:0@lo:400:kworker.0 00000100:00100000:0.0:1787856819.549528:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436356864:0@lo:400:kworker.0 00010000:00080000:0.0:1787856819.549536:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a503c0 x1874703436357888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856819.549545:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436357888:0@lo:400:kworker.0 00000100:00100000:2.0:1787856819.550248:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436357376 00000100:00100000:2.0:1787856819.550281:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436357376 00000100:00100000:2.0:1787856819.550330:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787856819.550338:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436357376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856819.550393:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436357376:12345-0@lo:400:kworker.0 Request processed in 56us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856819.550400:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787856819.550466:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.550596:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426845440 00000100:00100000:3.0:1787856819.550601:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426845440 00000100:00100000:3.0:1787856819.550637:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:3.0:1787856819.550644:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+63:11397:x1874703426845440:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787856819.550691:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856819.550718:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c434f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60bc expref: 63 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550735:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7500) 00010000:00010000:3.0:1787856819.550746:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856819.550768:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550783:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550794:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550809:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550824:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550833:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550920:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550927:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550933:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550939:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.550943:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550950:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550959:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:3.0:1787856819.550963:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856819.550967:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550972:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c435d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550982:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.550995:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.551001:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.551006:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.551008:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.551014:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.551021:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3d0ddf7a (ffff9065d3599600) 00010000:00010000:3.0:1787856819.551024:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856819.551026:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.551031:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4364 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3d0ddf7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.551092:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+62:11397:x1874703426845440:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 448us (627us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787856819.551098:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:0.0:1787856819.552102:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436357376:0@lo:400:kworker.0 00000100:00100000:2.0:1787856819.559397:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856819.561086:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426845568 00000100:00100000:1.0:1787856819.561100:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426845568 00000100:00100000:1.0:1787856819.561232:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:1.0:1787856819.561244:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+62:11397:x1874703426845568:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856819.561266:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856819.561304:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c436b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60c3 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.561343:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.561357:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.561369:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.561484:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c436b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 64 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.561502:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 63 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.561510:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:1.0:1787856819.561647:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787856819.561651:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939800, rc 0) 00000100:00100000:1.0:1787856819.561719:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+63:11397:x1874703426845568:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 477us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856819.561726:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:0.0:1787856819.565423:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.565716:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426845824 00000100:00100000:2.0:1787856819.565726:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426845824 00000100:00100000:2.0:1787856819.565792:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:2.0:1787856819.565802:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+63:11397:x1874703426845824:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787856819.565899:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.565917:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.565928:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856819.566098:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1787856819.566150:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba1556c5 reply state 000000001e17de74 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.566164:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.566173:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:2.0:1787856819.566176:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787856819.566192:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856819.566328:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+65:11397:x1874703426845824:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 527us (926us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787856819.566337:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:2.0:1787856819.568954:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.569321:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426845952 00000100:00100000:0.0:1787856819.569334:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426845952 00000100:00100000:0.0:1787856819.569401:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:0.0:1787856819.569411:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+65:11397:x1874703426845952:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856819.569435:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856819.569688:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60ca expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.569750:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 66 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.569765:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 66 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.569783:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:0.0:1787856819.569786:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787856819.569790:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba200, rc 0) 00000100:00100000:0.0:1787856819.569928:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+66:11397:x1874703426845952:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 517us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.569935:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:0.0:1787856819.577539:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.577716:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426846080 00000100:00100000:3.0:1787856819.577730:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426846080 00000100:00100000:3.0:1787856819.577828:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1787856819.577851:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426846080:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787856819.578352:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+9:2402:x1874703426846080:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 503us (827us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787856819.578368:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00080000:0.0:1787856819.578621:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856819.581758:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856819.583693:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426846336 00000100:00100000:1.0:1787856819.583712:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426846336 00000100:00100000:1.0:1787856819.583840:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:1.0:1787856819.583852:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+66:11397:x1874703426846336:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787856819.584174:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+67:11397:x1874703426846336:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 323us (2428us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1787856819.584183:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:2.0:1787856819.588634:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856819.589271:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426846592 00000100:00100000:1.0:1787856819.589281:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426846592 00000100:00100000:1.0:1787856819.589347:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:1.0:1787856819.589358:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+67:11397:x1874703426846592:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787856819.589482:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+67:11397:x1874703426846592:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 126us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856819.589489:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:0.0:1787856819.594164:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.594254:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426846720 00000100:00100000:3.0:1787856819.594278:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426846720 00000100:00100000:3.0:1787856819.594336:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:3.0:1787856819.594347:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+67:11397:x1874703426846720:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787856819.594368:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856819.594388:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4387 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60d1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.594473:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c438e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.594488:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c438e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.594499:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c438e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856819.594551:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787856819.594572:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c438e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.594599:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c4387 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d1 expref: 69 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.594618:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c438e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d1 expref: 68 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.594626:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:3.0:1787856819.594629:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787856819.594633:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff200, rc 0) 00000100:00100000:3.0:1787856819.594694:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+68:11397:x1874703426846720:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 348us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856819.594708:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:0.0:1787856819.610419:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.610624:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426846848 00000100:00100000:2.0:1787856819.610633:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426846848 00000100:00100000:2.0:1787856819.610695:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:2.0:1787856819.610704:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+9:2401:x1874703426846848:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856819.610723:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856819.610744:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60d8 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856819.610769:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9087b3, blocks: 0x0 00010000:00010000:2.0:1787856819.610789:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1787856819.610793:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856819.610802:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 10 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.610821:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 10 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.610833:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b000, rc 0) 00000100:00100000:2.0:1787856819.610903:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+10:2401:x1874703426846848:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 200us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856819.610910:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:2.0:1787856819.621815:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856819.621935:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426847104 00000100:00100000:1.0:1787856819.621945:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426847104 00000100:00100000:1.0:1787856819.622015:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:1.0:1787856819.622025:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065cd6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+68:11397:x1874703426847104:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787856819.622145:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065cd6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+68:11397:x1874703426847104:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 122us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856819.622153:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:0.0:1787856819.628804:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.628997:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426847232 00000100:00100000:2.0:1787856819.629007:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426847232 00000100:00100000:2.0:1787856819.629064:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1787856819.629074:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+10:11397:x1874703426847232:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856819.629093:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856819.629113:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60df expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.629147:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.629157:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856819.629161:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856819.629167:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 11 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.629203:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.629260:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 11 pid: 8409 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856819.629285:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436358016:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856819.629382:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe90e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856819.633988:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436358016:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856819.634043:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 11 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.634063:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a400, rc 0) 00000100:00100000:2.0:1787856819.634127:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+11:11397:x1874703426847232:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 5054us (5331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856819.634136:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1787856819.640030:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.640359:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426847360 00000100:00100000:0.0:1787856819.640368:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426847360 00010000:00010000:0.0:1787856819.640409:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 11 pid: 8409 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.640467:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1787856819.640477:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+11:2401:x1874703426847360:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856819.640509:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856819.640532:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 11 pid: 8409 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.640546:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 11 pid: 8409 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.640580:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4395 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d8 expref: 11 pid: 8409 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.640599:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856819.640603:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856819.640612:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.640622:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.640674:0:8425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.640688:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f2580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8425:1874703436358144:192.168.202.6@tcp:105: 00000100:00100000:0.0:1787856819.640778:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760780 going to sleep for 11 seconds 00000100:00100000:2.0:1787856819.649605:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f2580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8425:1874703436358144:192.168.202.6@tcp:105: 00010000:00010000:2.0:1787856819.649632:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856819.649692:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+10:2401:x1874703426847360:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 9215us (9670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856819.649703:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:3.0:1787856819.650033:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.650241:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426847488 00000100:00100000:2.0:1787856819.650248:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426847488 00002000:00100000:2.0:1787856819.650289:0:8414:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9064c83fa1c0 x1874703426847488/t0(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:220/0 lens 504/0 e 0 to 0 dl 1787856830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787856819.650300:0:8414:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c83fa1c0 with x1874703426847488 ext(0->12) 00002000:00010000:2.0:1787856819.650305:0:8414:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9064c83fa1c0 00000100:00100000:2.0:1787856819.650337:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1787856819.650347:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:898e91b3-529b-44bc-a821-726bff6c71d4+10:2402:x1874703426847488:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787856819.651134:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:898e91b3-529b-44bc-a821-726bff6c71d4+12:2402:x1874703426847488:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 785us (1098us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787856819.651142:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00002000:00100000:2.0:1787856819.651150:0:8414:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9064c83fa1c0 x1874703426847488/t4294967309(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:220/0 lens 504/448 e 0 to 0 dl 1787856830 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787856819.651171:0:8414:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c83fa1c0 with x1874703426847488 ext(0->12) 00002000:00010000:2.0:1787856819.651174:0:8414:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9064c83fa1c0 00000100:00100000:3.0:1787856819.655784:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.655911:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426847616 00000100:00100000:2.0:1787856819.655920:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426847616 00000100:00100000:2.0:1787856819.655980:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:2.0:1787856819.655990:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+68:11397:x1874703426847616:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787856819.663104:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1787856819.663127:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:3.0:1787856819.663262:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663279:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663286:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663294:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.663299:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663307:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663324:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9064c793d200) 00010000:00010000:3.0:1787856819.663328:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856819.663334:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663341:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c40a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663365:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663385:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663389:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663392:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.663393:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663397:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663402:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9065c3c5f200) 00010000:00010000:3.0:1787856819.663404:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856819.663406:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663419:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4149 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663433:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663437:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663440:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663443:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.663448:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663453:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663469:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:3.0:1787856819.663472:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856819.663476:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663481:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c41c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663493:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663499:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663505:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663517:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.663520:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663525:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663530:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9064c793d800) 00010000:00010000:3.0:1787856819.663532:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856819.663538:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663542:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c41ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663556:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663562:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663568:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663573:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.663576:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663582:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663590:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:3.0:1787856819.663592:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856819.663596:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663602:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c42bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663613:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663619:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663629:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663632:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215ba00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.663634:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663638:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663643:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:3.0:1787856819.663644:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787856819.663646:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.663649:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4379 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787856819.663795:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787856819.663826:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9065c85f5840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787856819.663830:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065c89a4b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9065c85f5540 00000020:00080000:0.0:1787856819.663832:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065c89a4c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9064c883c400 00000004:00080000:0.0:1787856819.663868:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787856819.663883:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787856819.663974:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856819.663992:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436358272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787856819.664053:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856819.664099:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436358272 00000100:00100000:2.0:1787856819.664107:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436358272 00000100:00100000:2.0:1787856819.664163:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787856819.664173:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436358272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787856819.664198:0:8409:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787856819.664247:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9087b2, atime: 0x6a9087b2, ctime: 0x6a9087b2, blocks: 0x8 00010000:00010000:2.0:1787856819.664255:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664281:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1787856819.664285:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856819.664293:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664308:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664317:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664333:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664350:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787856819.664508:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3626:x1874703436358272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 336us (453us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787856819.664517:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1787856819.664539:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856819.664546:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664569:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215ae00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856819.664573:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664581:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664595:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664602:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c43a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.664619:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856819.664626:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856819.664628:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787856819.666079:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9064c83f8000/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787856819.666093:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436358272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787856819.670552:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436358400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787856819.670627:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856819.670685:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436358400 00000100:00100000:3.0:1787856819.670692:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436358400 00000100:00100000:3.0:1787856819.670744:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787856819.670767:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436358400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787856819.670794:0:10490:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1787856819.670820:0:10490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.670853:0:10490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 11 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.670872:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787856819.670876:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787856819.670880:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.670906:0:10490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 11 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.670922:0:10490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 11 pid: 10490 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.670934:0:10490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436358528:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856819.670992:0:10490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a9c0 going to sleep for 11 seconds 00000020:00080000:0.0:1787856819.672168:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9064c7001540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787856819.672176:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065fd4e3100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9065f5c7ff00 00000020:00080000:0.0:1787856819.672179:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065fd4e3f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9064c887fc00 00000020:00080000:2.0:1787856819.672497:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787856819.672569:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787856819.672800:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+16:11397:x1874703426847616:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 16807us (17019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856819.672810:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:3.0:1787856819.677146:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.677364:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426847744 00000100:00100000:2.0:1787856819.677374:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426847744 00000100:00100000:2.0:1787856819.677440:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:2.0:1787856819.677451:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+12:2402:x1874703426847744:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787856819.677648:0:10490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436358528:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856819.677674:0:10490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856819.678397:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.678745:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426847872 00000100:00100000:0.0:1787856819.678884:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426847872 00010000:00010000:0.0:1787856819.678916:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 13 pid: 10490 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.678951:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:0.0:1787856819.678959:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+13:2401:x1874703426847872:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856819.678971:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856819.678977:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 13 pid: 10490 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.678989:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 13 pid: 10490 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.679013:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62999aa/0xc25410d92a3c4157 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6037 expref: 13 pid: 10490 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.679029:0:13166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856819.679040:0:13166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856819.679046:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.679055:0:13166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.679190:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856819.679278:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+12:2401:x1874703426847872:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 319us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.679286:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00010000:00010000:1.0:1787856819.683266:0:10490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.683305:0:10490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.683317:0:10490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.683324:0:10490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.683602:0:10490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787856819.683821:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1874703436358400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13052us (13190us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787856819.683832:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1787856819.683930:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff906601a52580/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787856819.683951:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436358400:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787856819.684039:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856819.684053:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.684062:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856819.684066:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787856819.684068:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:3.0:1787856819.684075:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.684094:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.684101:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c43aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.684123:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856819.684125:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856819.684127:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787856819.684197:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1787856819.684385:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426847744:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 6935us (7246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856819.684391:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1787856819.688143:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.688277:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426848128 00000100:00100000:0.0:1787856819.688286:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426848128 00000100:00100000:0.0:1787856819.688348:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:0.0:1787856819.688358:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+16:11397:x1874703426848128:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787856819.688422:0:9124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856819.688450:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c438e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60d1 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.688480:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:0.0:1787856819.688485:0:9124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856819.688515:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.688549:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.688558:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856819.688675:0:9124:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bd43545 reply state 0000000021aa53d1 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.688686:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.688692:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:0.0:1787856819.688695:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856819.688698:0:9124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856819.689108:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+17:11397:x1874703426848128:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 750us (974us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1787856819.689117:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:3.0:1787856819.694901:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856819.696601:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426848256 00000100:00100000:1.0:1787856819.696615:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426848256 00000100:00100000:1.0:1787856819.696675:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:1.0:1787856819.696685:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426848256:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787856819.696836:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787856819.696840:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787856818 00002000:00010000:1.0:1787856819.696843:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787856818 00002000:00010000:1.0:1787856819.696845:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787856819 -> 1787856818 00002000:00010000:1.0:1787856819.696847:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787856819.697305:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2399:x1874703426848256:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 618us (2414us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787856819.697314:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:3.0:1787856819.716337:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.716438:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426848512 00000100:00100000:2.0:1787856819.716448:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426848512 00000100:00100000:2.0:1787856819.716519:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:2.0:1787856819.716530:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+17:11397:x1874703426848512:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787856819.716599:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.716616:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 17 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.716626:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.716672:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 17 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.716685:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 17 pid: 8909 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856819.716699:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436358656:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856819.716801:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe90ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787856819.720425:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436358656:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856819.720456:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.721518:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.721894:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426848640 00000100:00100000:2.0:1787856819.721903:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426848640 00010000:00010000:2.0:1787856819.721951:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 18 pid: 8909 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856819.722001:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:2.0:1787856819.722012:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+18:2401:x1874703426848640:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856819.722030:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856819.722037:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 18 pid: 8909 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.722051:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 18 pid: 8909 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.722077:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4372 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60c3 expref: 18 pid: 8909 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.722097:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:2.0:1787856819.722115:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.722126:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.722134:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.722165:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856819.722260:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+17:2401:x1874703426848640:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 250us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856819.722267:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00010000:00010000:3.0:1787856819.723523:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.723537:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.723578:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.723596:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.723602:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.723607:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856819.723612:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.723619:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.723633:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:3.0:1787856819.723635:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787856819.723640:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.723646:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c43b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.723713:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+16:11397:x1874703426848512:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 7183us (7383us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787856819.723723:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:3.0:1787856819.728432:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856819.728608:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426848768 00000100:00100000:2.0:1787856819.728619:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426848768 00000100:00100000:2.0:1787856819.728738:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:2.0:1787856819.728748:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2399:x1874703426848768:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787856819.728796:0:10490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.728817:0:10490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.728825:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856819.728830:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787856819.728834:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.728884:0:10490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.728914:0:10490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 7 pid: 8407 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856819.728930:0:10490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436358784:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856819.729014:0:10490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe90e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856819.735772:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.735878:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426848896 00000100:00100000:0.0:1787856819.735887:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426848896 00010000:00010000:0.0:1787856819.735922:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 8 pid: 8407 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.735956:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1787856819.735962:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426848896:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856819.735973:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856819.735989:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 8 pid: 8407 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.736016:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 8 pid: 8407 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.736037:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856819.736040:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856819.736045:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.736051:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.736066:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856819.736125:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426848896:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 163us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.736130:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00010000:00010000:3.0:1787856819.736432:0:10490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007263b31/0xc25410d92a3c439c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60df expref: 7 pid: 8407 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.736447:0:10490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436358784:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856819.736476:0:10490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736487:0:10490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736494:0:10490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736524:0:10490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736533:0:10490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736539:0:10490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736544:0:10490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215ba00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856819.736547:0:10490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736553:0:10490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736566:0:10490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.736582:0:10490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c06db80/0xc25410d92a3c43bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.736637:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426848768:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 7891us (8216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856819.736643:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:2.0:1787856819.751341:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.751494:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426849152 00000100:00100000:3.0:1787856819.751504:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426849152 00000100:00100000:3.0:1787856819.751582:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00100000:3.0:1787856819.751592:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+16:11397:x1874703426849152:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787856819.751671:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.751688:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.751698:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.751731:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.751745:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 16 pid: 6496 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.751760:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436358912:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856819.751888:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856819.755704:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436358912:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856819.755736:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856819.755909:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.756432:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426849280 00000100:00100000:3.0:1787856819.756439:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426849280 00010000:00010000:3.0:1787856819.756476:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 17 pid: 6496 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.756639:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:3.0:1787856819.756651:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c60e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+17:2402:x1874703426849280:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856819.756668:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856819.756676:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 17 pid: 6496 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.756688:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 17 pid: 6496 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.756711:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c42b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a608b expref: 17 pid: 6496 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.756727:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:3.0:1787856819.756733:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 16 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.756743:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.756767:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.756774:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.756808:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856819.756887:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c60e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+16:2402:x1874703426849280:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 237us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856819.756895:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00010000:00010000:2.0:1787856819.760706:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.760725:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.760955:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.760973:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 16 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.760981:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.761022:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 16 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856819.761038:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 16 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856819.761069:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8216d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436359040:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856819.761181:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe90e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856819.777770:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.778106:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426849408 00000100:00100000:0.0:1787856819.778116:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426849408 00010000:00010000:0.0:1787856819.778161:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 17 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.778205:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:0.0:1787856819.778215:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a50f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+17:2402:x1874703426849408:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856819.778250:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856819.778258:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 17 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.778302:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 17 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.778325:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:0.0:1787856819.778331:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.778341:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.778349:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.778368:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856819.778419:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a50f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+17:2402:x1874703426849408:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 206us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.778425:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00010000:00010000:0.0:1787856819.780005:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4380 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ca expref: 16 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.780028:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8216d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436359040:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856819.780051:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.780060:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.780066:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787856819.780193:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1787856819.781811:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1787856819.781882:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1787856819.781965:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1874703436359168:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787856819.782034:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856819.784139:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787856819.784268:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436359168 00000100:00100000:1.0:1787856819.784277:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436359168 00000100:00100000:1.0:1787856819.784338:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787856819.784348:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6496:x1874703436359168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787856819.784458:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6496:x1874703436359168:12345-0@lo:1000:mdt00_000.0 Request processed in 111us (2422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856819.784477:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787856819.784526:0:6496:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787856819.784532:0:6496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787856819.784563:0:6496:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff906601a52580 x1874703436358400/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787856835 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856819.784573:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1874703436359168:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787856819.784714:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787856819.784779:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a51680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1874703436359296:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787856819.784818:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856819.784851:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436359296 00000100:00100000:1.0:1787856819.784864:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436359296 00000100:00100000:1.0:1787856819.784883:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787856819.784888:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6496:x1874703436359296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787856819.784977:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6496:x1874703436359296:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (158us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787856819.784983:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787856819.785001:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856819.785017:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a51680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1874703436359296:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787856819.785063:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785073:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785081:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785088:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856819.785093:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785100:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785117:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:1.0:1787856819.785120:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856819.785125:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785132:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c43cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785155:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785161:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785167:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785182:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bba00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856819.785185:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785192:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785201:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856819.785203:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856819.785210:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 19 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785246:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 19 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785256:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 19 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.785282:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 19 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856819.785294:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a512c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436359424:192.168.202.6@tcp:105: 00000100:00100000:1.0:1787856819.785352:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd427540 going to sleep for 11 seconds 00000100:00100000:1.0:1787856819.790477:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.790960:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426849536 00000100:00100000:3.0:1787856819.790969:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426849536 00000100:00100000:3.0:1787856819.791031:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:3.0:1787856819.791042:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+20:11396:x1874703426849536:12345-192.168.202.6@tcp:49:lfs.0 00000100:00100000:3.0:1787856819.791207:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+20:11396:x1874703426849536:12345-192.168.202.6@tcp:49:lfs.0 Request processed in 167us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856819.791214:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1787856819.793431:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a512c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436359424:192.168.202.6@tcp:105: 00010000:00010000:0.0:1787856819.793470:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793481:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c4310 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793530:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793545:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793556:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793566:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793572:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793578:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793601:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856819.793606:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793613:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793626:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856819.793629:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856819.793632:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793639:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c43d4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793648:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793653:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793659:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793663:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856819.793665:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793670:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793689:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856819.793691:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787856819.793694:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.793700:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.795587:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+19:11397:x1874703426849152:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 43986us (44245us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787856819.795601:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 139 00000020:00080000:0.0:1787856819.795609:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787856819.796622:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856819.796629:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856819.801185:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787856819.801204:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787856819.802053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.802582:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426849792 00000100:00100000:0.0:1787856819.802594:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426849792 00000100:00100000:0.0:1787856819.802669:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00100000:0.0:1787856819.802680:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+19:11396:x1874703426849792:12345-192.168.202.6@tcp:58:lfs.0 00000040:00080000:0.0:1787856819.803727:0:9124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787856819.803848:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+19:11396:x1874703426849792:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 1156us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.803867:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00100000:1.0:1787856819.811195:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.811389:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426850048 00000100:00100000:3.0:1787856819.811399:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426850048 00000100:00100000:3.0:1787856819.811462:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:3.0:1787856819.811473:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0390850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+19:11397:x1874703426850048:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787856819.811775:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787856819.811811:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1787856819.812078:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.812097:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.812109:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.812118:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.812124:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.812131:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.812211:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787856819.812353:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0390850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+21:11397:x1874703426850048:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 880us (1168us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787856819.812362:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000020:00080000:3.0:1787856819.812368:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787856819.822671:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856819.822687:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.822699:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856819.822703:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.822737:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.822771:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:0.0:1787856819.822775:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787856819.822780:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.822786:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.822805:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856819.822807:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856819.822809:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856819.866103:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.866213:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426850176 00000100:00100000:3.0:1787856819.866265:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426850176 00000100:00100000:3.0:1787856819.866328:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:3.0:1787856819.866339:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+21:11399:x1874703426850176:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1787856819.866364:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856819.866386:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c43e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60e6 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866469:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866485:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866498:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866514:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866521:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866527:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866596:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866607:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 22 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866615:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866646:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 22 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856819.866670:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 22 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856819.866685:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436359552:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856819.867291:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856819.872429:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856819.872553:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426850432 00000100:00100000:3.0:1787856819.872562:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426850432 00000100:00100000:3.0:1787856819.872625:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:3.0:1787856819.872634:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+23:6171:x1874703426850432:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787856819.872877:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:6171:x1874703426850432:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 243us (458us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787856819.872886:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:2.0:1787856819.876159:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856819.876269:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426850560 00000100:00100000:0.0:1787856819.876278:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426850560 00010000:00010000:0.0:1787856819.876324:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 24 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856819.876366:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:0.0:1787856819.876377:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:2402:x1874703426850560:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856819.876392:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856819.876398:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 24 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.876411:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 24 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.876434:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856819.876455:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.876465:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.876473:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856819.876493:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856819.876558:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:2402:x1874703426850560:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856819.876566:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00010000:00010000:1.0:1787856819.877918:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4302 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60a7 expref: 23 pid: 9124 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856819.877939:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436359552:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856819.877962:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.877972:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.877978:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856819.878034:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787856819.878039:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856819.878061:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878087:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878097:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878105:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878111:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878118:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856819.878122:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878146:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878160:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856819.878163:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856819.878168:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878174:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c43e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878185:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878190:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878195:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878200:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856819.878202:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878208:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878214:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9065d3599100) 00010000:00010000:1.0:1787856819.878255:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856819.878258:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878275:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c43f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878315:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c43e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60e6 expref: 23 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878329:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60e6 expref: 22 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856819.878336:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856819.878338:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856819.878341:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff200, rc 0) 00000100:00100000:1.0:1787856819.878416:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+22:11399:x1874703426850176:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 12079us (12324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856819.878424:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:3.0:1787856820.049670:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436359680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856820.049743:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856820.049828:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436359680 00000100:00100000:3.0:1787856820.049836:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436359680 00000100:00100000:3.0:1787856820.049901:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787856820.049910:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436359680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856820.049932:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856820.049974:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436359680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856820.049981:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787856820.050028:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436359680:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787856820.050121:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787856820.126169:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856820.561669:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856820.561705:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436359808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856820.561781:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856820.561888:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436359808 00000100:00100000:1.0:1787856820.561896:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436359808 00000100:00100000:1.0:1787856820.561948:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787856820.561958:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436359808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856820.561989:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787856820.562033:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436359808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856820.562040:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787856820.562120:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436359808:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787856820.818002:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856820.818010:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856820.818039:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787856820.818046:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787856820.818176:0:13777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436359936:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787856820.818290:0:13777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c12edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856820.820866:0:13777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436359936:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787856820.824166:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856820.824344:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426850688 00000100:00100000:1.0:1787856820.824355:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426850688 00000100:00100000:1.0:1787856820.824416:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:1.0:1787856820.824427:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:11410:x1874703426850688:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787856820.824483:0:6496:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787856820.824617:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:11410:x1874703426850688:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 191us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856820.824625:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:3.0:1787856820.831580:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856820.832873:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426850944 00000100:00100000:0.0:1787856820.832886:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426850944 00000100:00100000:0.0:1787856820.832963:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 143 00000100:00100000:0.0:1787856820.832973:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+22:11410:x1874703426850944:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856820.832992:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856820.833009:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c43fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60ed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856820.833110:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4405 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856820.833125:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856820.833151:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856820.833164:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787856820.833295:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bba00/0xc25410d92a3c43fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ed expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856820.833313:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4405 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ed expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856820.833321:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856820.833324:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856820.833327:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba200, rc 0) 00000100:00100000:0.0:1787856820.833384:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:11410:x1874703426850944:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 412us (1812us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787856820.833392:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 143 00000100:00100000:3.0:1787856820.841230:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856820.841268:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856820.841306:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426851200 00000100:00100000:3.0:1787856820.841315:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426851200 00000100:00100000:3.0:1787856820.841364:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 144 00000100:00100000:3.0:1787856820.841374:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+24:11410:x1874703426851200:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787856820.841442:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841460:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841472:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841615:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841633:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841641:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841647:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856820.841652:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841659:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841671:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:3.0:1787856820.841674:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787856820.841678:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856820.841684:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c4413 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856820.841805:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+25:11410:x1874703426851200:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 432us (600us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787856820.841813:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 144 00000040:00080000:3.0:1787856820.841904:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856820.841909:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856820.842422:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787856820.842430:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787856820.846116:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426851328 00000100:00100000:0.0:1787856820.846133:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426851328 00000100:00100000:0.0:1787856820.846237:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1787856820.846250:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+25:2400:x1874703426851328:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856820.846266:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856820.846293:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4405 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ed expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856820.846313:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:0.0:1787856820.846319:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856820.846385:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+24:2400:x1874703426851328:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 139us (5116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856820.846394:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1787856820.852835:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000040:00080000:1.0:1787856820.854204:0:14292:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787856820.854212:0:14292:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787856820.854272:0:14292:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787856820.854278:0:14292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787856820.855459:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426851584 00000100:00100000:0.0:1787856820.855472:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426851584 00000100:00100000:0.0:1787856820.855528:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:0.0:1787856820.855539:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:11410:x1874703426851584:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787856820.855882:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+25:11410:x1874703426851584:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 344us (3055us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787856820.855891:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:3.0:1787856821.072322:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856821.072439:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426851840 00000100:00100000:1.0:1787856821.072450:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426851840 00000100:00100000:1.0:1787856821.072529:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:1.0:1787856821.072540:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+25:11423:x1874703426851840:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856821.072566:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856821.072586:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c441a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60f4 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856821.072696:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4421 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856821.072710:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4421 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856821.072721:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4421 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856821.072731:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787856821.072835:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c441a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60f4 expref: 28 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856821.072876:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60f4 expref: 27 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856821.073357:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856821.073361:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787856821.073364:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939800, rc 0) 00000100:00100000:1.0:1787856821.073421:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+27:11423:x1874703426851840:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 883us (1109us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787856821.073430:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00080000:2.0:1787856821.073530:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856821.076877:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856821.076998:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426851968 00000100:00100000:3.0:1787856821.077008:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426851968 00000100:00100000:3.0:1787856821.077058:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:3.0:1787856821.077066:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+27:11423:x1874703426851968:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1787856821.077128:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077145:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077158:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077193:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077200:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077207:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077213:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856821.077251:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077258:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077269:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:3.0:1787856821.077272:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856821.077277:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856821.077296:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c442f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856821.077367:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+27:11423:x1874703426851968:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 301us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856821.077374:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:0.0:1787856821.077956:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856821.077972:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436360064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856821.078016:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856821.078204:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436360064 00000100:00100000:1.0:1787856821.078209:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436360064 00000100:00100000:1.0:1787856821.078272:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787856821.078281:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436360064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856821.078306:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787856821.078351:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436360064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856821.078358:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787856821.078443:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436360064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787856821.139205:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856821.206853:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856821.206970:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426852096 00000100:00100000:0.0:1787856821.206991:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426852096 00000100:00100000:0.0:1787856821.207066:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:0.0:1787856821.207077:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426852096:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1787856821.207095:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856821.207116:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4436 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a60fb expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787856821.207141:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9087b2, atime: 0x6a9087b2, ctime: 0x6a9087b2, blocks: 0x8 00010000:00010000:0.0:1787856821.207161:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1787856821.207165:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856821.207174:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4436 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60fb expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856821.207199:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4436 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60fb expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856821.207213:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bba00, rc 0) 00000100:00100000:0.0:1787856821.207305:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426852096:12345-192.168.202.6@tcp:101:cat.0 Request processed in 230us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856821.207313:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00080000:2.0:1787856821.207776:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856821.217042:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856821.217136:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426852224 00000100:00100000:3.0:1787856821.217147:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426852224 00002000:00100000:3.0:1787856821.217199:0:8415:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9064c8241a40 x1874703426852224/t0(0) o3->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:222/0 lens 488/0 e 0 to 0 dl 1787856832 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856821.217209:0:8415:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c8241a40 with x1874703426852224 ext(0->4095) 00002000:00010000:3.0:1787856821.217258:0:8415:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9064c8241a40 00000100:00100000:3.0:1787856821.217294:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:3.0:1787856821.217305:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8241a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426852224:12345-192.168.202.6@tcp:3:cat.0 00000100:00100000:3.0:1787856821.217484:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8241a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426852224:12345-192.168.202.6@tcp:3:cat.0 Request processed in 180us (451us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787856821.217492:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00002000:00100000:3.0:1787856821.217500:0:8415:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9064c8241a40 x1874703426852224/t0(0) o3->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:222/0 lens 488/4536 e 0 to 0 dl 1787856832 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856821.217507:0:8415:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c8241a40 with x1874703426852224 ext(0->4095) 00002000:00010000:3.0:1787856821.217511:0:8415:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9064c8241a40 00000040:00080000:1.0:1787856822.098539:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787856822.165942:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856822.757903:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856822.757940:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856822.757963:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856822.757988:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856822.758010:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856822.758020:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426852352 00000100:00100000:3.0:1787856822.758029:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426852352 00000100:00100000:1.0:1787856822.758029:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856822.758048:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856822.758069:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426852864 00000100:00100000:1.0:1787856822.758083:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426852864 00000100:00100000:3.0:1787856822.758095:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 386 00000100:00100000:3.0:1787856822.758110:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426852352:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856822.758110:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426852736 00000100:00100000:1.0:1787856822.758112:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426852736 00000100:00100000:2.0:1787856822.765030:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:2.0:1787856822.765201:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426852864:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856822.765949:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:1.0:1787856822.765961:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426852736:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856822.772433:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426852352:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 14312us (14526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856822.772449:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 386 00000100:00100000:3.0:1787856822.772498:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426852608 00000100:00100000:3.0:1787856822.772505:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426852608 00000100:00100000:3.0:1787856822.772552:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426853120 00000100:00100000:3.0:1787856822.772555:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426853120 00000100:00100000:3.0:1787856822.772566:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426852480 00000100:00100000:3.0:1787856822.772568:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426852480 00000100:00100000:3.0:1787856822.772577:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426852992 00000100:00100000:3.0:1787856822.772579:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426852992 00000100:00100000:3.0:1787856822.772592:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 315 00000100:00100000:3.0:1787856822.772599:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426852608:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856822.772698:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 316 00000100:00100000:0.0:1787856822.772708:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426853120:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856822.778378:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426852864:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 12214us (19294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856822.778395:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:2.0:1787856822.778464:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 317 00000100:00100000:2.0:1787856822.778481:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+27:2400:x1874703426852480:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856822.778558:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+27:2400:x1874703426852480:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 85us (20547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856822.778564:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 317 00000100:00100000:2.0:1787856822.778583:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 318 00000100:00100000:2.0:1787856822.778591:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426852992:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856822.778618:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426852992:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (20569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856822.778641:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 318 00000100:00080000:2.0:1787856822.778665:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856822.778670:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856822.778673:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856822.780765:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426852736:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 14798us (22725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856822.781136:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:3.0:1787856822.781527:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426852608:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 8924us (23583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856822.781537:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 315 00000100:00100000:0.0:1787856822.781961:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426853120:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 9252us (23969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856822.781971:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 316 00000040:00080000:3.0:1787856822.865393:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856822.865410:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856822.865433:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787856822.865440:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787856823.186008:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787856824.148868:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1787856824.148885:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:3.0:1787856824.210779:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787856824.657449:0:9841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358367229736ns, next at 359367226566ns, rc = 0 00000100:00100000:1.0:1787856824.657508:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436360320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856824.657573:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856824.660940:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856824.660967:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436360192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856824.661104:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856824.661169:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436360320 00000100:00100000:2.0:1787856824.661177:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436360320 00000100:00100000:2.0:1787856824.661453:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436360192 00000100:00100000:2.0:1787856824.661457:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436360192 00000100:00100000:2.0:1787856824.661480:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787856824.661489:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436360320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856824.661519:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856824.661567:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436360320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856824.661575:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787856824.661592:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787856824.661599:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874703436360192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787856824.661615:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787856824.661646:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874703436360192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856824.661652:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1787856824.661783:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787856824.661787:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856824.661908:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436360320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856824.661926:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787856824.661932:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436360448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856824.661962:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856824.661999:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436360192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856824.662016:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436360448 00000100:00100000:2.0:1787856824.662019:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436360448 00000100:00100000:2.0:1787856824.663175:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787856824.663186:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066009f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436360448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856824.663201:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787856824.663262:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066009f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436360448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856824.663269:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1787856824.663498:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856824.663529:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436360448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856824.664022:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436360704:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664140:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664175:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436361216:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664200:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664241:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436361728:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664263:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664287:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787856824.664293:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436360576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664320:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664348:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436361088:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664373:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664391:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436361600:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664414:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664440:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436360960:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664464:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664483:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436361472:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664504:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664521:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787856824.664527:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436360832:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664546:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664562:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436361344:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664583:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856824.664608:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436360704 00000100:00100000:0.0:1787856824.664614:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436360704 00000100:00100000:0.0:1787856824.664643:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436361728 00000100:00100000:0.0:1787856824.664645:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436361728 00000100:00100000:0.0:1787856824.664667:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436361600 00000100:00100000:0.0:1787856824.664670:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436361600 00000100:00100000:0.0:1787856824.664680:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436360960 00000100:00100000:0.0:1787856824.664682:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436360960 00000100:00100000:0.0:1787856824.664692:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436361472 00000100:00100000:0.0:1787856824.664694:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436361472 00000100:00100000:0.0:1787856824.664707:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436361344 00000100:00100000:0.0:1787856824.664710:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436361344 00000100:00100000:0.0:1787856824.664724:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787856824.664731:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436360704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.664770:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436360704:12345-0@lo:400:kworker.0 Request processed in 39us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.664783:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787856824.667940:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787856824.667958:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436361728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.668859:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436361728:12345-0@lo:400:kworker.0 Request processed in 903us (4591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.668870:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787856824.668894:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787856824.668903:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436361600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.668939:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436361600:12345-0@lo:400:kworker.0 Request processed in 39us (4524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.668945:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787856824.668959:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787856824.668966:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436360960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669007:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436360960:12345-0@lo:400:kworker.0 Request processed in 42us (4542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.669013:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787856824.669158:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787856824.669168:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436361472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669202:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436361472:12345-0@lo:400:kworker.0 Request processed in 36us (4697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.669208:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787856824.669239:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787856824.669247:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436361344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669276:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436361344:12345-0@lo:400:kworker.0 Request processed in 31us (4693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.669290:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787856824.669319:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436361216 00000100:00100000:0.0:1787856824.669326:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436361216 00000100:00100000:0.0:1787856824.669364:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787856824.669371:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436361216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669405:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436361216:12345-0@lo:400:kworker.0 Request processed in 35us (5204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.669411:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787856824.669435:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436360576 00000100:00100000:0.0:1787856824.669440:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436360576 00000100:00100000:0.0:1787856824.669465:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787856824.669471:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436360576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669499:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436360576:12345-0@lo:400:kworker.0 Request processed in 29us (5178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.669505:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787856824.669533:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436361088 00000100:00100000:0.0:1787856824.669537:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436361088 00000100:00100000:0.0:1787856824.669554:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436360832 00000100:00100000:0.0:1787856824.669557:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436360832 00000100:00100000:0.0:1787856824.669571:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787856824.669577:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436361088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669611:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436361088:12345-0@lo:400:kworker.0 Request processed in 34us (5237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.669616:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787856824.669627:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787856824.669633:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436360832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669669:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436360832:12345-0@lo:400:kworker.0 Request processed in 37us (5122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856824.669676:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1787856824.669710:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856824.669714:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856824.669717:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856824.669751:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436360832:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669763:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436361344:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.669773:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436360960:0@lo:400:kworker.0 00010000:00080000:0.0:1787856824.669786:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066007f3480 x1874703436361472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856824.670213:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436361472:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.670329:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436360576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.670343:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436361088:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.670355:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436361600:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.670368:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436360704:0@lo:400:kworker.0 00000100:00100000:0.0:1787856824.670379:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1787856824.670384:0:3626:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1787856824.670398:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9064c83f8000, transno 4294967305 00000100:00100000:0.0:1787856824.670415:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436361216:0@lo:400:kworker.0 00010000:00080000:0.0:1787856824.670428:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066007f30c0 x1874703436361728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856824.670452:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436361728:0@lo:400:kworker.0 00000100:00100000:1.0:1787856825.170190:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856825.170213:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436361856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856825.170315:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856825.170794:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436361856 00000100:00100000:3.0:1787856825.170811:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436361856 00000100:00100000:3.0:1787856825.170866:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787856825.170875:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436361856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856825.170898:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856825.170948:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436361856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856825.170962:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787856825.171006:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436361856:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787856825.173073:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:2.0:1787856825.173124:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1787856825.173154:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9065c85f5a80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787856825.173159:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065f5c45000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9065c85f5cc0 00000020:00080000:2.0:1787856825.173162:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065f5c45e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9066008d5e00 00000020:00080000:2.0:1787856825.173185:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787856825.173201:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787856825.173309:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1787856825.173593:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856825.173606:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856825.173614:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856825.173621:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856825.173625:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856825.173634:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856825.173653:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9065c46a7e00) 00010000:00010000:0.0:1787856825.173656:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856825.173661:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856825.173668:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c43b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856825.173698:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856825.173715:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436361984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787856825.173775:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856825.173917:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436361984 00000100:00100000:2.0:1787856825.173924:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436361984 00000100:00100000:2.0:1787856825.173974:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787856825.173997:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436361984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787856825.174105:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787856825.174109:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787856818 -> 1787856818 00002000:00010000:2.0:1787856825.174111:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1787856818 -> 1787856818 00002000:00010000:2.0:1787856825.174113:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787856818 -> 1787856818 00002000:00010000:2.0:1787856825.174116:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787856825.174161:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3623:x1874703436361984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (385us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787856825.174168:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1787856825.174653:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff906601a53840/2, rc 0, transno 4294967313 00000100:00100000:0.0:1787856825.174661:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436361984:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1787856825.180603:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787856825.180618:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1787856825.233490:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856825.683783:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436362112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856825.683867:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856825.684245:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436362112 00000100:00100000:3.0:1787856825.684252:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436362112 00000100:00100000:3.0:1787856825.684303:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787856825.684312:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436362112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856825.684342:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856825.684395:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436362112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856825.684408:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787856825.684488:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436362112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856826.196140:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436362240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856826.196233:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856826.196938:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436362240 00000100:00100000:1.0:1787856826.196948:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436362240 00000100:00100000:1.0:1787856826.197001:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787856826.197010:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436362240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856826.197042:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787856826.197102:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436362240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856826.197109:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787856826.197307:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436362240:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856826.258683:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856827.290443:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856827.634735:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856827.634881:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426853248 00000100:00100000:0.0:1787856827.634898:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426853248 00000100:00100000:0.0:1787856827.635018:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:0.0:1787856827.635031:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+13:11076:x1874703426853248:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787856827.635157:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+13:11076:x1874703426853248:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 Request processed in 128us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856827.635165:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00080000:2.0:1787856827.635398:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856827.641612:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856827.642986:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426853376 00000100:00100000:0.0:1787856827.643007:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426853376 00000100:00100000:0.0:1787856827.643596:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:0.0:1787856827.643614:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:11076:x1874703426853376:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787856827.643915:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856827.644456:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:11076:x1874703426853376:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 Request processed in 844us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856827.644468:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:3.0:1787856827.649600:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856827.650614:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426853632 00000100:00100000:0.0:1787856827.650631:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426853632 00000100:00100000:0.0:1787856827.650726:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:0.0:1787856827.650739:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+13:11076:x1874703426853632:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787856827.652049:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+14:11076:x1874703426853632:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 1286us (2438us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787856827.652063:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:1.0:1787856827.868476:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856827.868517:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856827.868564:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856827.868587:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856827.868607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856827.869205:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426853760 00000100:00100000:3.0:1787856827.869242:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426853760 00000100:00100000:3.0:1787856827.869316:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 388 00000100:00100000:3.0:1787856827.869327:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2402:x1874703426853760:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856827.869408:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2402:x1874703426853760:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856827.869417:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 388 00000100:00100000:2.0:1787856827.870004:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426854144 00000100:00100000:2.0:1787856827.870019:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426854144 00000100:00100000:2.0:1787856827.870122:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426854272 00000100:00100000:2.0:1787856827.870127:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426854272 00000100:00100000:2.0:1787856827.870162:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 325 00000100:00100000:2.0:1787856827.870173:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426854144:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856827.870285:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426854144:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 113us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856827.870293:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 325 00000100:00100000:2.0:1787856827.870312:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 326 00000100:00100000:2.0:1787856827.870335:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426854272:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856827.870363:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426854272:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856827.870370:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 326 00000100:00100000:2.0:1787856827.870392:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426853888 00000100:00100000:2.0:1787856827.870395:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426853888 00000100:00100000:2.0:1787856827.870424:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426854016 00000100:00100000:2.0:1787856827.870427:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426854016 00000100:00100000:2.0:1787856827.870452:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:2.0:1787856827.870459:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426853888:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856827.870487:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426853888:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856827.870494:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:2.0:1787856827.870506:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:2.0:1787856827.870512:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426854016:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856827.870540:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426854016:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856827.870546:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00080000:3.0:1787856827.871075:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856827.871084:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856827.871088:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856827.871090:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856828.164318:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856828.164568:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426854400 00000100:00100000:0.0:1787856828.164579:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426854400 00000100:00100000:0.0:1787856828.164709:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 149 00000100:00100000:0.0:1787856828.164722:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:11881:x1874703426854400:12345-192.168.202.6@tcp:101:lsof.0 00010000:00010000:0.0:1787856828.164754:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856828.164797:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c443d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6102 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856828.164867:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856828.164881:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856828.164896:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856828.165070:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787856828.165075:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856828.165116:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856828.165140:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c443d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 7 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856828.165159:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 6 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856828.165167:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:0.0:1787856828.165170:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787856828.165189:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bae00, rc 0) 00000100:00100000:0.0:1787856828.165453:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:11881:x1874703426854400:12345-192.168.202.6@tcp:101:lsof.0 Request processed in 608us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856828.165465:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 149 00010000:00010000:0.0:1787856828.305465:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856829.329409:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856829.777426:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856829.777451:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8242d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436362368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856829.777489:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856829.777502:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436362880:0@lo:400:kworker.0 00000100:00100000:2.0:1787856829.777529:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856829.777543:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856829.777557:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436362624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856829.777588:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856829.777632:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436362752:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.777670:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856829.777676:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436362880 00000100:00100000:1.0:1787856829.777685:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436362880 00000100:00100000:3.0:1787856829.777701:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436362368 00000100:00100000:3.0:1787856829.777707:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436362368 00000100:00100000:1.0:1787856829.777731:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787856829.777741:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436362880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.777751:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436362624 00000100:00100000:3.0:1787856829.777755:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436362624 00000100:00100000:3.0:1787856829.777788:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787856829.777795:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436362368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856829.777818:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787856829.777852:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436362368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856829.777861:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787856829.777882:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787856829.777889:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436362624:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856829.777895:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8242d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436362368:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856829.777907:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856829.777921:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436363008:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.777942:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436362624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856829.777950:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787856829.777957:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856829.778008:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436362880:12345-0@lo:400:kworker.0 Request processed in 268us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856829.778015:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1787856829.778060:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856829.778065:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856829.779929:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436363520:0@lo:400:kworker.0 00000100:00100000:2.0:1787856829.779984:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856829.780009:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436364032:0@lo:400:kworker.0 00000100:00100000:2.0:1787856829.780034:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856829.780065:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787856829.780071:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436363392:0@lo:400:kworker.0 00000100:00100000:2.0:1787856829.780095:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856829.780113:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436363904:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.780132:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436362752 00000100:00100000:2.0:1787856829.780138:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856829.780142:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436362752 00000100:00100000:3.0:1787856829.780185:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436363008 00000100:00100000:3.0:1787856829.780189:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436363008 00000100:00100000:2.0:1787856829.780194:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436363520 00000100:00100000:2.0:1787856829.780200:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436363520 00000100:00100000:3.0:1787856829.780207:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436363392 00000100:00100000:3.0:1787856829.780211:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436363392 00000100:00100000:3.0:1787856829.780244:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436363904 00000100:00100000:3.0:1787856829.780247:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436363904 00000100:00100000:2.0:1787856829.780260:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787856829.780272:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436362752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.780275:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787856829.780280:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436362880:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.780286:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436363008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.780289:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436362496:0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.780333:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856829.780367:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436363008:12345-0@lo:400:kworker.0 Request processed in 73us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856829.780375:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787856829.780391:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1787856829.780397:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436363392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.780419:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787856829.780423:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436363392:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856829.780426:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436363520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.780428:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787856829.780457:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436363520:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856829.780464:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787856829.780477:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787856829.780483:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436363904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.780512:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436363904:12345-0@lo:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00080000:1.0:1787856829.780520:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856829.780521:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:1.0:1787856829.780528:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856829.780563:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436362496 00000100:00100000:1.0:1787856829.780568:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436362496 00000100:00100000:3.0:1787856829.780609:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436362624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856829.780612:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787856829.780625:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436363136:0@lo:400:kworker.0 00000100:00100000:1.0:1787856829.780626:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436362496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.780670:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856829.780685:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436362496:12345-0@lo:400:kworker.0 Request processed in 62us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856829.780694:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787856829.780699:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436363648:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.780731:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856829.780733:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436364032 00000100:00100000:1.0:1787856829.780738:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436364032 00000100:00100000:3.0:1787856829.780756:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436364160:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.780876:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856829.780894:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436362752:12345-0@lo:400:kworker.0 Request processed in 625us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856829.780902:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787856829.782233:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436363392:0@lo:400:kworker.0 00010000:00080000:0.0:1787856829.782253:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83db0c0 x1874703436363904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856829.782284:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436363904:0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.782300:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436363008:0@lo:400:kworker.0 00010000:00080000:0.0:1787856829.783144:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83db840 x1874703436363520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856829.783165:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436363520:0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.783244:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436362496:0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.783388:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436362752:0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.783399:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436363264:0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.783467:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436363136 00000100:00100000:0.0:1787856829.783474:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436363136 00000100:00100000:0.0:1787856829.783520:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787856829.783529:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436363136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856829.783584:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436363136:12345-0@lo:400:kworker.0 Request processed in 56us (2915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856829.783591:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787856829.785206:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436363136:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.785232:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856829.785240:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436364288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856829.785279:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856829.785529:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436363648 00000100:00100000:1.0:1787856829.785536:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436363648 00000100:00100000:1.0:1787856829.785572:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436364160 00000100:00100000:1.0:1787856829.785575:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436364160 00000100:00100000:1.0:1787856829.785605:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787856829.785628:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436364032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856829.785683:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436364032:12345-0@lo:400:kworker.0 Request processed in 57us (5647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856829.785690:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787856829.785706:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787856829.785711:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436363648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856829.785745:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436363648:12345-0@lo:400:kworker.0 Request processed in 34us (5014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856829.785751:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787856829.786056:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787856829.786066:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436364160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.786099:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436364160:12345-0@lo:400:kworker.0 Request processed in 35us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856829.786104:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787856829.786131:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856829.786153:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436363776:0@lo:400:kworker.0 00000100:00100000:1.0:1787856829.786163:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436363264 00000100:00100000:1.0:1787856829.786177:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436363264 00000100:00100000:3.0:1787856829.786182:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856829.786207:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787856829.786235:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436363264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.786246:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436364288 00000100:00100000:3.0:1787856829.786250:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436364288 00000100:00100000:3.0:1787856829.786279:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787856829.786286:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065c4a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436364288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856829.786298:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436363264:12345-0@lo:400:kworker.0 Request processed in 83us (165us total) trans 0 rc 0/0 00002000:00000024:3.0:1787856829.786300:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787856829.786311:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787856829.786340:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436363776 00000100:00100000:3.0:1787856829.786341:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065c4a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436364288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856829.786346:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436363776 00000100:00100000:3.0:1787856829.786351:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787856829.786381:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787856829.786388:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436363776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856829.786419:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436363776:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856829.786425:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787856829.786454:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436363264:0@lo:400:kworker.0 00000100:00100000:1.0:1787856829.786465:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436363776:0@lo:400:kworker.0 00000100:00080000:1.0:1787856829.786497:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856829.786501:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856829.786503:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787856829.786527:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436364032:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.786779:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787856829.786786:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff906601a52580, transno 4294967310 00000004:00080000:3.0:1787856829.786856:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787856829.786878:0:3625:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff906601a53840 x1874703436361984/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787856841 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856829.786895:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436364288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856829.786912:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436363648:0@lo:400:kworker.0 00000100:00100000:3.0:1787856829.786922:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436364160:0@lo:400:kworker.0 00000100:00100000:3.0:1787856830.290971:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787856830.290995:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436364416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856830.291065:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856830.291247:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436364416 00000100:00100000:2.0:1787856830.291255:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436364416 00000100:00100000:2.0:1787856830.291324:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787856830.291334:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436364416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787856830.291369:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856830.291422:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436364416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856830.291430:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787856830.291472:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436364416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787856830.354533:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856830.805877:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436364544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856830.805984:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856830.806358:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436364544 00000100:00100000:0.0:1787856830.806368:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436364544 00000100:00100000:0.0:1787856830.806426:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787856830.806436:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7a96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436364544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856830.806468:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856830.806528:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7a96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436364544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856830.806546:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787856830.806783:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436364544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856831.313824:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436364672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856831.313895:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856831.314112:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436364672 00000100:00100000:1.0:1787856831.314120:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436364672 00000100:00100000:1.0:1787856831.314185:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787856831.314195:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436364672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856831.314247:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787856831.314300:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436364672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856831.314308:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787856831.314575:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436364672:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1787856831.316527:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1787856831.316543:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1787856831.318436:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000020:00080000:2.0:1787856831.319917:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787856831.319941:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787856831.377471:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787856832.082297:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856832.082306:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856832.082408:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787856832.082416:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787856832.340133:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787856832.406321:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787856832.412724:0:14490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:53:50 (1787856830) 00000100:00100000:2.0:1787856832.998793:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856832.998867:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856832.998902:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856832.998946:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856832.998978:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856832.999009:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426855040 00000100:00100000:2.0:1787856832.999017:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426855040 00000100:00100000:2.0:1787856832.999077:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:2.0:1787856832.999087:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8241e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426855040:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856832.999155:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8241e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426855040:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856832.999163:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00080000:2.0:1787856832.999185:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856832.999641:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426854656 00000100:00100000:0.0:1787856832.999647:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426854656 00000100:00100000:0.0:1787856832.999683:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426854784 00000100:00100000:0.0:1787856832.999686:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426854784 00000100:00100000:0.0:1787856832.999706:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426855296 00000100:00100000:0.0:1787856832.999709:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426855296 00000100:00100000:0.0:1787856832.999724:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 333 00000100:00100000:0.0:1787856832.999762:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+13:2400:x1874703426854656:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856832.999806:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+13:2400:x1874703426854656:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856832.999813:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 333 00000100:00100000:0.0:1787856832.999832:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 334 00000100:00100000:0.0:1787856832.999838:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426854784:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856832.999863:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426854784:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856832.999869:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 334 00000100:00100000:0.0:1787856832.999883:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 335 00000100:00100000:0.0:1787856832.999889:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426855296:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856832.999919:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426855296:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856832.999926:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 335 00000100:00100000:1.0:1787856833.000126:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426854528 00000100:00100000:1.0:1787856833.000130:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426854528 00000100:00100000:1.0:1787856833.000170:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 390 00000100:00100000:1.0:1787856833.000178:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426854528:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856833.000209:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426854528:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 32us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856833.000239:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 390 00000100:00080000:2.0:1787856833.000517:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856833.000522:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856833.002998:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856833.003057:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856833.003138:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426855168 00000100:00100000:1.0:1787856833.003147:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426855168 00000100:00100000:1.0:1787856833.003250:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 336 00000100:00100000:1.0:1787856833.003260:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2400:x1874703426855168:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856833.003324:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2400:x1874703426855168:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856833.003332:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 336 00000100:00100000:0.0:1787856833.003422:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426854912 00000100:00100000:0.0:1787856833.003426:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426854912 00000100:00100000:0.0:1787856833.003460:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:0.0:1787856833.003465:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426854912:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856833.003491:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426854912:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856833.003497:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00080000:2.0:1787856833.004106:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787856833.004112:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787856833.429177:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856833.518581:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856833.518693:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426855552 00000100:00100000:0.0:1787856833.518702:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426855552 00000100:00100000:0.0:1787856833.518784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 150 00000100:00100000:0.0:1787856833.518803:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+13:12148:x1874703426855552:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856833.518823:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856833.518844:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c444b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6109 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.518914:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.518929:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.518940:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.518955:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.518962:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.518986:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519087:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4460 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519095:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4460 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519102:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4460 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856833.519111:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787856833.519186:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519194:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519199:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519205:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856833.519208:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519246:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519259:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9065c3c5fd00) 00010000:00010000:0.0:1787856833.519262:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856833.519272:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519276:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4452 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519286:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519289:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519293:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519296:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bac00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856833.519297:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519300:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519304:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9065c5490f00) 00010000:00010000:0.0:1787856833.519306:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856833.519307:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.519310:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4459 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.520059:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c444b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6109 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.520089:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4460 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6109 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856833.520095:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:0.0:1787856833.520097:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856833.520099:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007baa00, rc 0) 00000100:00100000:0.0:1787856833.520170:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+15:12148:x1874703426855552:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1377us (1599us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787856833.520178:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 150 00000100:00100000:0.0:1787856833.545682:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856833.545740:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856833.545845:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426855808 00000100:00100000:2.0:1787856833.545854:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426855808 00000100:00100000:2.0:1787856833.545921:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1787856833.545931:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+15:2400:x1874703426855808:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856833.545946:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856833.545986:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4460 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6109 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856833.546006:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:2.0:1787856833.546012:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856833.546076:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+14:2400:x1874703426855808:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 146us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856833.546084:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:3.0:1787856833.546520:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426855680 00000100:00100000:3.0:1787856833.546526:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426855680 00000100:00100000:3.0:1787856833.546568:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 151 00000100:00100000:3.0:1787856833.546576:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+14:12148:x1874703426855680:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787856833.546639:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+14:12148:x1874703426855680:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 64us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856833.546646:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 151 00000100:00100000:2.0:1787856833.571265:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856833.571358:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426855936 00000100:00100000:3.0:1787856833.571369:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426855936 00000100:00100000:3.0:1787856833.571433:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 152 00000100:00100000:3.0:1787856833.571443:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:12148:x1874703426855936:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787856833.571671:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:12148:x1874703426855936:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 229us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856833.571678:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 152 00000040:00080000:3.0:1787856834.129582:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856834.129597:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856834.130415:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787856834.130430:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787856834.387747:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787856834.450993:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856834.898369:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856834.898391:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436364800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856834.898464:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.898530:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436364800 00000100:00100000:2.0:1787856834.898537:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436364800 00000100:00100000:2.0:1787856834.898590:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787856834.898598:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436364800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856834.898625:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787856834.898668:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436364800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.898675:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1787856834.898696:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856834.898743:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436364800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856834.901862:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436364928:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.901941:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.901982:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7925a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436365440:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902012:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902044:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436365952:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902070:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902098:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787856834.902104:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436365056:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902152:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436365568:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902171:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902189:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8282940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436366080:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902210:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902264:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436365440 00000100:00100000:2.0:1787856834.902271:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436365440 00000100:00100000:2.0:1787856834.902314:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787856834.902323:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436365440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902379:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436365440:12345-0@lo:400:kworker.0 Request processed in 57us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.902387:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787856834.902410:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436365952 00000100:00100000:2.0:1787856834.902413:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436365952 00000100:00100000:2.0:1787856834.902442:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436365568 00000100:00100000:2.0:1787856834.902444:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436365568 00000100:00100000:2.0:1787856834.902466:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787856834.902472:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436365952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902502:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436365952:12345-0@lo:400:kworker.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.902509:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787856834.902520:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787856834.902527:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436365568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902563:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436365568:12345-0@lo:400:kworker.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.902569:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787856834.902592:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436365056 00000100:00100000:2.0:1787856834.902595:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436365056 00000100:00100000:2.0:1787856834.902618:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436366080 00000100:00100000:2.0:1787856834.902621:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436366080 00000100:00100000:2.0:1787856834.902643:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787856834.902649:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436365056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902678:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436365056:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.902684:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787856834.902695:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787856834.902701:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436366080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902742:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436366080:12345-0@lo:400:kworker.0 Request processed in 41us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.902748:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787856834.902774:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436365312:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902818:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436365824:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902836:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902849:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436366336:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902867:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902883:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787856834.902889:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8214780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436365184:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902934:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436365696:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902957:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.902971:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8280f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436366208:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.902991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856834.903010:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436365312 00000100:00100000:2.0:1787856834.903014:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436365312 00000100:00100000:2.0:1787856834.903032:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436365824 00000100:00100000:2.0:1787856834.903034:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436365824 00000100:00100000:2.0:1787856834.903047:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436365696 00000100:00100000:2.0:1787856834.903050:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436365696 00000100:00100000:2.0:1787856834.903062:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436366208 00000100:00100000:2.0:1787856834.903064:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436366208 00000100:00100000:2.0:1787856834.903078:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787856834.903083:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436365312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903118:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436365312:12345-0@lo:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.903123:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787856834.903135:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787856834.903140:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436365824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903165:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436365824:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.903169:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787856834.903179:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787856834.903184:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436365696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903206:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436365696:12345-0@lo:400:kworker.0 Request processed in 22us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.903211:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787856834.903252:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787856834.903258:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436366208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903285:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436366208:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.903291:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:2.0:1787856834.903310:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856834.903314:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856834.903316:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856834.903324:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436365184 00000100:00100000:2.0:1787856834.903327:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436365184 00000100:00100000:2.0:1787856834.903341:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787856834.903346:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436365184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903375:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436365184:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.903381:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787856834.903398:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436366336 00000100:00100000:2.0:1787856834.903402:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436366336 00000100:00100000:2.0:1787856834.903426:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787856834.903431:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436366336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903459:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436366336:12345-0@lo:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856834.903465:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1787856834.903480:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856834.903511:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8214780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436365184:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903521:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436365696:0@lo:400:kworker.0 00010000:00080000:2.0:1787856834.903532:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8280f00 x1874703436366208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856834.903554:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8280f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436366208:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903565:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436365312:0@lo:400:kworker.0 00010000:00080000:2.0:1787856834.903574:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8280780 x1874703436365824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856834.903582:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436365824:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903590:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1787856834.903595:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff906601a53840, transno 4294967313 00000100:00100000:2.0:1787856834.903614:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436366336:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903652:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436365056:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903662:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436365568:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903672:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8282940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436366080:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903684:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7925a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436365440:0@lo:400:kworker.0 00000100:00100000:2.0:1787856834.903694:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436365952:0@lo:400:kworker.0 00000100:00100000:0.0:1787856834.903879:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436364928 00000100:00100000:0.0:1787856834.903883:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436364928 00000100:00100000:0.0:1787856834.903911:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787856834.903918:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436364928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856834.903954:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436364928:12345-0@lo:400:kworker.0 Request processed in 36us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856834.903960:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787856834.904004:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856834.904014:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436366464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856834.904042:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856834.904071:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436366464 00000100:00100000:0.0:1787856834.904074:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436366464 00000100:00100000:0.0:1787856834.904098:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787856834.904104:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436366464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856834.904136:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856834.904169:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436366464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856834.904174:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787856834.904201:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436366464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856834.904251:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436364928:0@lo:400:kworker.0 00000100:00100000:0.0:1787856834.904961:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436366592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856834.904998:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856834.905073:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436366592 00000100:00100000:1.0:1787856834.905078:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436366592 00000100:00100000:1.0:1787856834.905121:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787856834.905130:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436366592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856834.905144:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787856834.905177:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436366592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856834.905184:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787856834.905318:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436366592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856835.409452:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436366720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856835.409529:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856835.409657:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436366720 00000100:00100000:3.0:1787856835.409664:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436366720 00000100:00100000:3.0:1787856835.409727:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787856835.409737:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7925a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436366720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856835.409759:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856835.409803:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7925a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436366720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856835.409810:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787856835.409894:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436366720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856835.473641:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856835.478317:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856835.478556:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426856064 00000100:00100000:3.0:1787856835.478570:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426856064 00000100:00100000:3.0:1787856835.478676:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 153 00000100:00100000:3.0:1787856835.478703:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+14:12191:x1874703426856064:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1787856835.478739:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856835.478778:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c446e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6110 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.478864:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.478880:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.478894:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479064:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479077:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479085:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479142:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479151:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479158:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479164:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fee00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856835.479169:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479177:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479190:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:3.0:1787856835.479193:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856835.479198:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479204:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fee00/0xc25410d92a3c4475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479250:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479256:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479261:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479267:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856835.479270:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479276:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479284:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9065d3599f00) 00010000:00010000:3.0:1787856835.479286:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856835.479289:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479294:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c447c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479330:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c446e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6110 expref: 15 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479340:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:3.0:1787856835.479342:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856835.479352:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c446e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6110 expref: 15 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.479362:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe400, rc 0) 00000100:00100000:3.0:1787856835.479437:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+14:12191:x1874703426856064:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 750us (1135us total) trans 0 rc 301/301 00000100:00100000:3.0:1787856835.479445:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 153 00000100:00080000:1.0:1787856835.480664:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856835.483384:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856835.483474:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426856320 00000100:00100000:3.0:1787856835.483487:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426856320 00000100:00100000:3.0:1787856835.483565:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:3.0:1787856835.483578:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+14:12191:x1874703426856320:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:3.0:1787856835.483656:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856835.483913:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c3dc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f34 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.483995:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:3.0:1787856835.484001:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856835.484079:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.484098:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 5 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.484108:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.484154:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 5 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.484193:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 5 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856835.484212:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a51680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436366848:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856835.484379:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856835.489508:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a51680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436366848:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856835.489542:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1787856835.489560:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856835.489583:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426856448 00000100:00100000:2.0:1787856835.489591:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426856448 00010000:00010000:2.0:1787856835.489658:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 6 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856835.489725:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:2.0:1787856835.489735:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2401:x1874703426856448:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856835.489754:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856835.489762:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 6 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.489777:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 6 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.489807:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c4444 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6102 expref: 6 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.489832:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:2.0:1787856835.489838:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.489849:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.489858:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.489885:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856835.489963:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2401:x1874703426856448:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 229us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856835.489972:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00080000:3.0:1787856835.490439:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787856835.490456:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.490466:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.490498:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.490510:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.490519:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494264:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494293:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494318:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787856835.494343:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a05c339 reply state 00000000569e4ff6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494357:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494365:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:3.0:1787856835.494369:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787856835.494375:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787856835.494382:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787856835.494391:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494398:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494406:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494413:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856835.494418:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494427:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494440:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5b79400) 00010000:00010000:3.0:1787856835.494443:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856835.494455:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494463:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c4483 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787856835.494486:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a05c339 reply state 00000000569e4ff6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494495:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.494501:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9065d3599a00) 00010000:00010000:3.0:1787856835.494504:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787856835.494506:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787856835.494643:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+15:12191:x1874703426856320:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 11060us (11265us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787856835.494655:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:2.0:1787856835.617078:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856835.617660:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426856576 00000100:00100000:0.0:1787856835.617672:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426856576 00000100:00100000:0.0:1787856835.617751:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 155 00000100:00100000:0.0:1787856835.617762:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+15:12199:x1874703426856576:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:0.0:1787856835.617787:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856835.617810:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6117 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.617876:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c449f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.617903:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c449f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.617917:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c449f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856835.619113:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787856835.619119:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856835.619146:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c449f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.619176:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c4498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6117 expref: 17 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.619194:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c449f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6117 expref: 16 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.619203:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:2.0:1787856835.619206:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856835.619209:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bae00, rc 0) 00000100:00100000:2.0:1787856835.619719:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+16:12199:x1874703426856576:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 1948us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856835.619729:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 155 00000100:00100000:2.0:1787856835.702313:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856835.704555:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426856704 00000100:00100000:3.0:1787856835.704571:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426856704 00000100:00100000:2.0:1787856835.704863:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 156 00000100:00100000:2.0:1787856835.704876:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8282940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+16:12205:x1874703426856704:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856835.704896:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856835.704915:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c44a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a611e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.704990:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705004:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705034:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705046:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705053:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705059:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705147:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c44bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705156:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c44bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705163:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c44bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856835.705201:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787856835.705204:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856835.705246:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c44bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705258:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705265:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705281:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705286:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856835.705290:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705297:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705309:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:2.0:1787856835.705312:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856835.705316:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705323:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c44ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705337:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705343:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705349:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705354:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856835.705357:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705372:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705381:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9065d3599a00) 00010000:00010000:2.0:1787856835.705384:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856835.705387:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705393:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c44b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705417:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c44a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a611e expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705429:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c44bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a611e expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.705436:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856835.705438:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787856835.705441:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ac00, rc 0) 00000100:00100000:2.0:1787856835.705517:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8282940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+17:12205:x1874703426856704:12345-192.168.202.6@tcp:101:bash.0 Request processed in 643us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856835.705525:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 156 00000100:00100000:1.0:1787856835.712837:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856835.713045:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426856960 00000100:00100000:3.0:1787856835.713055:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426856960 00000100:00100000:2.0:1787856835.713271:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 157 00000100:00100000:2.0:1787856835.713284:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+17:12205:x1874703426856960:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856835.713305:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856835.713324:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c44c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6125 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.713440:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.713452:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.713462:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.713526:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.713533:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.713540:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787856835.713853:0:8909:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787856835.713980:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.713989:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.713997:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714027:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714039:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714044:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714048:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856835.714051:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714057:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714065:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856835.714067:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856835.714070:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714073:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c44c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856835.714083:0:8909:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a759648 reply state 0000000044c06032 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714091:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714097:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c793d400) 00010000:00010000:2.0:1787856835.714099:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787856835.714102:0:8909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787856835.714130:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c44c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 20 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714151:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 19 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.714158:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c793dc00) 00010000:00010000:2.0:1787856835.714160:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856835.714162:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215aa00, rc 0) 00000100:00100000:2.0:1787856835.714269:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+20:12205:x1874703426856960:12345-192.168.202.6@tcp:101:bash.0 Request processed in 988us (1441us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787856835.714277:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 157 00000100:00100000:2.0:1787856835.718851:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856835.718935:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426857088 00000100:00100000:1.0:1787856835.718945:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426857088 00000100:00100000:1.0:1787856835.719024:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:1.0:1787856835.719035:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426857088:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787856835.719053:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856835.719074:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a612c expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787856835.719112:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787856835.719131:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1787856835.719135:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856835.719145:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.719163:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.719189:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938a00, rc 0) 00000100:00080000:3.0:1787856835.719329:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856835.719422:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426857088:12345-192.168.202.6@tcp:101:bash.0 Request processed in 389us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856835.719430:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:1.0:1787856835.726274:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856835.726778:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426857216 00000100:00100000:2.0:1787856835.726788:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426857216 00000100:00100000:2.0:1787856835.726843:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:2.0:1787856835.726854:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:12205:x1874703426857216:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856835.726873:0:10490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856835.726891:0:10490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6133 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.726927:0:10490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.726935:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856835.726939:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856835.726945:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 7 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.727016:0:10490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.727028:0:10490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 7 pid: 8407 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856835.727040:0:10490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8280780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10490:1874703436366976:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856835.727147:0:10490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c12edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856835.740153:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856835.740205:0:10490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8280780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10490:1874703436366976:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856835.740277:0:10490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 7 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.740300:0:10490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215be00, rc 0) 00000100:00100000:3.0:1787856835.740331:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426857344 00000100:00100000:3.0:1787856835.740337:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426857344 00000100:00100000:2.0:1787856835.740365:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+8:12205:x1874703426857216:12345-192.168.202.6@tcp:101:bash.0 Request processed in 13513us (14102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856835.740374:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00010000:00010000:3.0:1787856835.740376:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 8 pid: 8407 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856835.740401:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:3.0:1787856835.740411:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426857344:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856835.740429:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856835.740465:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 7 pid: 8407 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.740477:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 7 pid: 8407 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.740498:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcb278b2/0xc25410d92a3c44e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a612c expref: 7 pid: 8407 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.740513:0:13165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856835.740518:0:13165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856835.740526:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 6 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.740614:0:13165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 6 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.740696:0:13165:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 6 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856835.740779:0:13165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a51680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13165:1874703436367104:192.168.202.6@tcp:105: 00000100:00100000:3.0:1787856835.740892:0:13165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d21480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856835.744788:0:13165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a51680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13165:1874703436367104:192.168.202.6@tcp:105: 00010000:00010000:3.0:1787856835.744831:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856835.745030:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+6:2401:x1874703426857344:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 4618us (4885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856835.745066:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:2.0:1787856835.750461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856835.751064:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426857600 00000100:00100000:3.0:1787856835.751077:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426857600 00000100:00100000:3.0:1787856835.751264:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:3.0:1787856835.751278:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+20:12205:x1874703426857600:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:3.0:1787856835.751837:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+21:12205:x1874703426857600:12345-192.168.202.6@tcp:35:bash.0 Request processed in 560us (1390us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787856835.751847:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:1.0:1787856835.852362:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856835.852436:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426857856 00000100:00100000:2.0:1787856835.852449:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426857856 00000100:00100000:2.0:1787856835.852634:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:2.0:1787856835.852648:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+21:12215:x1874703426857856:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856835.852683:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856835.852731:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c44f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a613a expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856835.852900:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787856835.853045:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c44f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a613a expref: 23 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.853062:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:2.0:1787856835.853065:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787856835.853071:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c44f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a613a expref: 23 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.853089:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a600, rc 0) 00000100:00100000:2.0:1787856835.853174:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+22:12215:x1874703426857856:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 529us (823us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1787856835.853183:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:0.0:1787856835.856504:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856835.856616:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426858112 00000100:00100000:1.0:1787856835.856630:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426858112 00000100:00100000:1.0:1787856835.856989:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:1.0:1787856835.857005:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:12215:x1874703426858112:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1787856835.857344:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+23:12215:x1874703426858112:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 343us (850us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787856835.857353:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:2.0:1787856835.921738:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436367232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856835.921856:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856835.922635:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436367232 00000100:00100000:0.0:1787856835.922645:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436367232 00000100:00100000:0.0:1787856835.922725:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787856835.922737:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436367232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856835.922784:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856835.922864:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436367232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856835.922872:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787856835.923010:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436367232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856835.934520:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856835.934651:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426858240 00000100:00100000:2.0:1787856835.934663:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426858240 00000100:00100000:2.0:1787856835.934766:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:2.0:1787856835.934779:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+23:12221:x1874703426858240:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856835.934815:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856835.934844:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6141 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.935047:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4508 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.935085:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.935098:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856835.935159:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787856835.935164:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856835.935187:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.935257:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6141 expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.935280:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6141 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.935289:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856835.935292:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856835.935297:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b200, rc 0) 00000100:00100000:2.0:1787856835.935446:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:12221:x1874703426858240:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 669us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856835.935455:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:2.0:1787856835.940125:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856835.940293:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426858496 00000100:00100000:3.0:1787856835.940306:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426858496 00000100:00100000:3.0:1787856835.940433:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 160 00000100:00100000:3.0:1787856835.940447:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+24:12221:x1874703426858496:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1787856835.940475:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856835.940502:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c450f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6148 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.940646:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4516 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.940665:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.940679:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856835.940712:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787856835.940901:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c450f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6148 expref: 27 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.940937:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6148 expref: 26 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.940948:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c793dc00) 00010000:00010000:3.0:1787856835.940952:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787856835.940956:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9000, rc 0) 00000100:00100000:3.0:1787856835.941087:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+26:12221:x1874703426858496:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 643us (974us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787856835.941096:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 160 00000100:00100000:1.0:1787856835.945788:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856835.945831:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856835.946167:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426858880 00000100:00100000:0.0:1787856835.946180:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426858880 00000100:00100000:0.0:1787856835.946306:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1787856835.946319:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+26:2400:x1874703426858880:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856835.946343:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856835.946378:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4516 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6148 expref: 26 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.946404:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c793dc00) 00010000:00010000:0.0:1787856835.946411:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856835.946481:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+25:2400:x1874703426858880:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 165us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856835.946489:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:2.0:1787856835.948137:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426858752 00000100:00100000:2.0:1787856835.948150:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426858752 00000100:00100000:2.0:1787856835.948247:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 161 00000100:00100000:2.0:1787856835.948259:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+25:12221:x1874703426858752:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856835.948311:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856835.948337:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4524 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a614f expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.948472:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c452b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.948490:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c452b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.948503:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c452b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856835.948518:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787856835.948651:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4524 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a614f expref: 28 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.948670:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c452b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a614f expref: 27 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.948680:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c793dc00) 00010000:00010000:2.0:1787856835.948698:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787856835.948712:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215bc00, rc 0) 00000100:00100000:2.0:1787856835.950299:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+27:12221:x1874703426858752:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2031us (4513us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1787856835.950313:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 161 00000100:00100000:1.0:1787856835.957055:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856835.957154:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426859008 00000100:00100000:2.0:1787856835.957168:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426859008 00000100:00100000:2.0:1787856835.957279:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1787856835.957312:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+6:2400:x1874703426859008:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:2.0:1787856835.957374:0:8410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.957401:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 6 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.957411:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856835.957416:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787856835.957421:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.957471:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 6 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.957487:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 6 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856835.957505:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cfc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1874703436367360:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856835.957621:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c6547480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856835.963109:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856835.963279:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426859136 00000100:00100000:1.0:1787856835.963291:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426859136 00002000:00100000:1.0:1787856835.963359:0:8413:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff906601a53840 x1874703426859136/t0(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:236/0 lens 504/0 e 0 to 0 dl 1787856846 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787856835.963372:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff906601a53840 with x1874703426859136 ext(0->12) 00010000:00010000:1.0:1787856835.963383:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 7 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.963414:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 7 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787856835.963423:0:8413:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff906601a53840 00000100:00100000:1.0:1787856835.963465:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1787856835.963479:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426859136:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:2.0:1787856835.964392:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cfc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1874703436367360:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856835.964428:0:8410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856835.964864:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+9:2402:x1874703426859136:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 1385us (1766us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787856835.964876:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00002000:00100000:1.0:1787856835.964890:0:8413:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff906601a53840 x1874703426859136/t4294967306(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:236/0 lens 504/448 e 0 to 0 dl 1787856846 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787856835.964899:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff906601a53840 with x1874703426859136 ext(0->12) 00010000:00010000:1.0:1787856835.964907:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 9 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.964933:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 9 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787856835.964942:0:8413:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff906601a53840 00000100:00100000:0.0:1787856835.968379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856835.968715:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426859264 00000100:00100000:1.0:1787856835.968730:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426859264 00010000:00010000:1.0:1787856835.968795:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 9 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856835.968877:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:1.0:1787856835.968889:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+9:2399:x1874703426859264:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856835.968909:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787856835.969169:0:13166:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787856835.969174:0:13166:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787856835 00002000:00010000:1.0:1787856835.969177:0:13166:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787856835 00002000:00010000:1.0:1787856835.969179:0:13166:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787856835 00002000:00010000:1.0:1787856835.969181:0:13166:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787856835.969189:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 9 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.969206:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 9 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.969281:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c44ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6133 expref: 9 pid: 10490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.969305:0:13166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787856835.969311:0:13166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787856835.969318:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.969331:0:13166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.969389:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856835.969537:0:8410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.969559:0:8410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.969585:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.969595:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.969603:0:8410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.969612:0:8410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856835.969616:0:8410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.969627:0:8410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.969640:0:8410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856835.969648:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dd2de81/0xc25410d92a3c4539 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856835.969768:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+8:2399:x1874703426859264:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 880us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856835.969778:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:2.0:1787856835.970526:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426859008:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 13213us (13482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856835.970539:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:3.0:1787856835.973403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856835.973574:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426859520 00000100:00100000:1.0:1787856835.973587:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426859520 00000100:00100000:1.0:1787856835.973717:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:1.0:1787856835.973730:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0392850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+27:12221:x1874703426859520:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:1.0:1787856835.973830:0:6499:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c452b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a614f expref: 27 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856835.974092:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787856835.974128:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787856835.974570:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1787856835.974619:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.974639:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 31 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.974648:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.974691:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 31 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.974720:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 31 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856835.974788:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1874703436367488:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856835.974899:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856835.980110:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856835.980632:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426859648 00000100:00100000:0.0:1787856835.980663:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426859648 00010000:00010000:0.0:1787856835.980745:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 32 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856835.980807:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:0.0:1787856835.980819:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+32:2401:x1874703426859648:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856835.980838:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856835.980846:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 32 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.980861:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 32 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.980890:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c793dc00) 00010000:00010000:0.0:1787856835.980897:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.980907:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.980916:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856835.980949:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856835.981286:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+32:2401:x1874703426859648:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 465us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856835.981295:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00010000:00010000:1.0:1787856835.982062:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c44d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6125 expref: 31 pid: 8909 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856835.982085:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1874703436367488:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856835.982110:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.982120:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.982125:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856835.982598:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1787856835.983202:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787856835.983731:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436367616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787856835.983822:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856835.983933:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436367616 00000100:00100000:1.0:1787856835.983937:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787856835.983943:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436367616 00000100:00100000:2.0:1787856835.984044:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787856835.984061:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436367616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787856835.984183:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436367616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 129us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856835.984191:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787856835.984366:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436367616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787856835.984526:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1787856835.984586:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436367744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787856835.984617:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856835.984643:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856835.984714:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436367744 00000100:00100000:0.0:1787856835.984720:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436367744 00000100:00100000:0.0:1787856835.984777:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787856835.984785:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1874703436367744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787856835.984984:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6499:x1874703436367744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 199us (365us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787856835.984992:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787856835.985057:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1874703436367744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787856835.985101:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1787856835.985133:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.985141:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.985146:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.985150:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856835.985154:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.985159:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.985175:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c793dc00) 00010000:00010000:1.0:1787856835.985177:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787856835.985181:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856835.985186:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4540 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787856835.985442:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787856835.985507:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787856835.985517:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369695299276ns, next at 370695297171ns, rc = 0 00000001:00080000:1.0:1787856835.985616:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1787856835.985641:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c793dc00) 00010000:00010000:1.0:1787856835.985643:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787856835.985655:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c452b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a614f expref: 35 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856835.985846:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0392850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+34:12221:x1874703426859520:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 12119us (12457us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787856835.985857:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000020:00080000:1.0:1787856835.985862:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787856835.987832:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856835.987935:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426859776 00000100:00100000:3.0:1787856835.987946:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426859776 00000100:00100000:3.0:1787856835.988016:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 162 00000100:00100000:3.0:1787856835.988028:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+34:12221:x1874703426859776:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1787856835.988058:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856835.988087:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4547 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6156 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.988156:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4547 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6156 expref: 35 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.988173:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4547 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6156 expref: 35 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856835.988275:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856835.988279:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787856835.988284:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9e00, rc 0) 00000100:00100000:3.0:1787856835.988353:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8216d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+35:12221:x1874703426859776:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 327us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856835.988361:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 162 00000100:00100000:0.0:1787856835.991897:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856835.992098:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426860032 00000100:00100000:3.0:1787856835.992111:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426860032 00000100:00100000:3.0:1787856835.992255:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1787856835.992269:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+35:12221:x1874703426860032:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856835.992581:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+36:12221:x1874703426860032:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 315us (697us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787856835.992589:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:2.0:1787856836.077817:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856836.077939:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426860288 00000100:00100000:3.0:1787856836.077952:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426860288 00000100:00100000:3.0:1787856836.078037:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 163 00000100:00100000:3.0:1787856836.078050:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+36:12231:x1874703426860288:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1787856836.078083:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856836.078111:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c454e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a615d expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856836.078298:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787856836.078427:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c454e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a615d expref: 38 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856836.078467:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:3.0:1787856836.078471:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856836.078478:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c454e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a615d expref: 38 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856836.078497:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8000, rc 0) 00000100:00100000:3.0:1787856836.078579:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+37:12231:x1874703426860288:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 531us (778us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787856836.078588:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 163 00000100:00100000:2.0:1787856836.085365:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856836.085612:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426860416 00000100:00100000:0.0:1787856836.085624:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426860416 00000100:00100000:0.0:1787856836.085716:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:0.0:1787856836.085729:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8214780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+37:12231:x1874703426860416:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1787856836.085848:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.085872:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.085886:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.085900:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.085908:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.085916:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086021:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086055:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086064:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856836.086131:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086148:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086156:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086163:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086170:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbe00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856836.086175:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086185:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086200:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856836.086204:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856836.086210:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086252:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c455c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086275:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086282:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086288:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086292:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856836.086295:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086301:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086308:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c793d400) 00010000:00010000:0.0:1787856836.086311:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856836.086314:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086320:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4563 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086330:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086335:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086340:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086351:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856836.086354:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086360:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086369:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856836.086371:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856836.086374:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.086379:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c456a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856836.087008:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8214780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+37:12231:x1874703426860416:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 1279us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856836.087019:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:2.0:1787856836.090839:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856836.092052:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426860672 00000100:00100000:1.0:1787856836.092068:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426860672 00000100:00100000:1.0:1787856836.092209:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:1.0:1787856836.092285:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+37:12231:x1874703426860672:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1787856836.092610:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+38:12231:x1874703426860672:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 329us (1788us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787856836.092621:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:2.0:1787856836.135508:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856836.135713:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426860928 00000100:00100000:1.0:1787856836.135727:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426860928 00000100:00100000:1.0:1787856836.135823:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:1.0:1787856836.135835:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+38:12234:x1874703426860928:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856836.135867:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856836.135893:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4571 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6164 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136477:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136498:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136512:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136554:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136562:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136568:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136722:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136732:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.136739:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856836.136749:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787856836.137387:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137398:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137405:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137411:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856836.137416:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137434:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137449:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856836.137452:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856836.137457:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137464:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4578 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137480:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137486:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137493:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137499:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938a00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856836.137501:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137507:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137515:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c793d400) 00010000:00010000:2.0:1787856836.137528:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856836.137532:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137549:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c457f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137605:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4571 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137621:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.137629:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856836.137632:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856836.137634:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938200, rc 0) 00000100:00100000:2.0:1787856836.137813:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+40:12234:x1874703426860928:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1979us (2318us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787856836.137823:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:2.0:1787856836.142008:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856836.142155:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426861056 00000100:00100000:0.0:1787856836.142168:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426861056 00000100:00100000:0.0:1787856836.142414:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:0.0:1787856836.142427:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+40:12234:x1874703426861056:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:0.0:1787856836.142637:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142661:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142676:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142750:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142758:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142766:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142773:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856836.142778:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142785:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142800:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856836.142804:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787856836.142810:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.142817:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856836.142959:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+40:12234:x1874703426861056:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 534us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856836.142968:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:0.0:1787856836.145364:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856836.145502:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426861312 00000100:00100000:3.0:1787856836.145513:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426861312 00000100:00100000:3.0:1787856836.145690:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:3.0:1787856836.145712:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+40:12234:x1874703426861312:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856836.146016:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+41:12234:x1874703426861312:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 315us (665us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787856836.146024:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:2.0:1787856836.383630:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856836.384764:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426861568 00000100:00100000:0.0:1787856836.384792:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426861568 00000100:00100000:0.0:1787856836.384910:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:0.0:1787856836.384924:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+41:12265:x1874703426861568:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1787856836.384960:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856836.384990:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c459b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a616b expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.385497:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c45a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.385518:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c45a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.385534:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c45a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856836.385548:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787856836.385710:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c459b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a616b expref: 44 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.385733:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c45a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a616b expref: 43 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.385743:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856836.385746:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856836.385750:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbe00, rc 0) 00000100:00100000:0.0:1787856836.385851:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+43:12265:x1874703426861568:12345-192.168.202.6@tcp:101:cat.0 Request processed in 930us (2238us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787856836.385860:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:2.0:1787856836.397533:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856836.397597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856836.397712:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426861952 00000100:00100000:0.0:1787856836.397742:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426861952 00000100:00100000:0.0:1787856836.397844:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:0.0:1787856836.397856:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+43:2400:x1874703426861952:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856836.397878:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856836.397913:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c45a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a616b expref: 43 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.397938:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856836.397945:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856836.398025:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+42:2400:x1874703426861952:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 170us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856836.398033:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1787856836.399042:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426861824 00000100:00100000:1.0:1787856836.399054:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426861824 00000100:00100000:1.0:1787856836.399110:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:1.0:1787856836.399119:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+42:12265:x1874703426861824:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:1.0:1787856836.399498:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+43:12265:x1874703426861824:12345-192.168.202.6@tcp:35:cat.0 Request processed in 378us (1980us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1787856836.399518:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:0.0:1787856836.434078:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436367872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856836.434182:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856836.434341:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436367872 00000100:00100000:3.0:1787856836.434350:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436367872 00000100:00100000:3.0:1787856836.434413:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787856836.434423:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d03fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436367872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856836.434467:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787856836.434523:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d03fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436367872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856836.434531:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787856836.435452:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436367872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856836.475621:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856836.480001:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426862208 00000100:00100000:0.0:1787856836.480020:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426862208 00000100:00100000:1.0:1787856836.484110:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:1.0:1787856836.484151:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+43:12271:x1874703426862208:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1787856836.484187:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856836.484191:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787856836.484261:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4508 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6141 expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.484288:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:1.0:1787856836.484294:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787856836.484312:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c45b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6172 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.484454:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.484471:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.484481:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.484527:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.484542:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 43 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856836.484559:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436368000:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856836.484717:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787856836.493609:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856836.494963:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426862336 00000100:00100000:2.0:1787856836.494980:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426862336 00010000:00010000:2.0:1787856836.495048:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 44 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856836.495110:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:2.0:1787856836.495122:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+44:2402:x1874703426862336:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856836.495164:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856836.495173:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 44 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.495189:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 44 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.495250:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856836.495258:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.495269:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.495279:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.495303:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856836.495385:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+44:2402:x1874703426862336:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 264us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856836.495393:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00010000:00010000:3.0:1787856836.497563:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856836.499048:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4586 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6164 expref: 43 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856836.499084:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436368000:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856836.499122:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.499136:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.499143:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856836.499173:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787856836.500124:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c45b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.500148:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.500157:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:1.0:1787856836.500161:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787856836.500165:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939a00, rc 0) 00000100:00100000:1.0:1787856836.500304:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+43:12271:x1874703426862208:12345-192.168.202.6@tcp:101:dd.0 Request processed in 16157us (24697us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787856836.500315:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:0.0:1787856836.510163:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856836.513400:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426862464 00000100:00100000:1.0:1787856836.513422:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426862464 00000100:00100000:2.0:1787856836.516198:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:2.0:1787856836.516253:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+43:12271:x1874703426862464:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1787856836.516290:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856836.516320:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6179 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.516367:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.516408:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.516423:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.516584:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 45 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.516608:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.516617:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856836.516620:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787856836.516625:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b600, rc 0) 00000100:00100000:2.0:1787856836.516742:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+44:12271:x1874703426862464:12345-192.168.202.6@tcp:101:dd.0 Request processed in 496us (6595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856836.516750:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:3.0:1787856836.520564:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856836.527394:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426862720 00000100:00100000:0.0:1787856836.527418:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426862720 00000100:00100000:2.0:1787856836.527590:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:2.0:1787856836.527609:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+44:12271:x1874703426862720:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:2.0:1787856836.527948:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.527984:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.527998:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856836.528077:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1787856836.528102:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fec08bd9 reply state 00000000924f9a49 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.528116:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.528125:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856836.528128:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787856836.528133:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856836.530468:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+47:12271:x1874703426862720:12345-192.168.202.6@tcp:36:dd.0 Request processed in 2848us (9901us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1787856836.530484:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 170 00000020:00080000:2.0:1787856836.530494:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787856836.845869:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856836.849373:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426862848 00000100:00100000:1.0:1787856836.849416:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426862848 00000100:00100000:1.0:1787856836.849528:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:1.0:1787856836.849542:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+47:12285:x1874703426862848:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:1.0:1787856836.849575:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856836.849605:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c45da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6180 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849711:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849729:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849741:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849753:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849761:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849768:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849864:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849877:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849886:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849935:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856836.849950:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 48 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856836.849980:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436368128:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856836.850178:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856836.852637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856836.852764:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436368128:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856836.852797:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426863104 00000100:00100000:0.0:1787856836.852806:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426863104 00010000:00010000:1.0:1787856836.852813:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856836.852879:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:0.0:1787856836.852890:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+49:6171:x1874703426863104:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787856836.853279:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+50:6171:x1874703426863104:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 390us (651us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787856836.853289:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1787856836.857279:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856836.857403:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426863232 00000100:00100000:0.0:1787856836.857417:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426863232 00010000:00010000:0.0:1787856836.857475:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 50 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856836.857790:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:0.0:1787856836.857802:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+50:2402:x1874703426863232:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856836.857823:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856836.857831:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 50 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.857847:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 50 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.857886:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c45b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6172 expref: 50 pid: 6496 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.857907:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856836.857913:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.857924:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.857933:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856836.857976:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856836.858046:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+49:2402:x1874703426863232:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 246us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856836.858074:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00010000:00010000:2.0:1787856836.858159:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858168:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856836.858266:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787856836.858272:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856836.858306:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858321:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858331:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858349:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858355:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858362:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856836.858367:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858375:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858386:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856836.858389:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856836.858394:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858402:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c45e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858413:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858419:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858425:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858431:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939c00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856836.858440:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858447:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858456:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c793d400) 00010000:00010000:2.0:1787856836.858459:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856836.858462:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858468:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c45e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858507:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c45da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6180 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858535:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6180 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.858543:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856836.858545:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856836.858548:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939000, rc 0) 00000100:00100000:2.0:1787856836.858580:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+48:12285:x1874703426862848:12345-192.168.202.6@tcp:101:stat.0 Request processed in 9043us (12727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856836.858588:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:1.0:1787856836.940708:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856836.940833:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426863488 00000100:00100000:2.0:1787856836.940848:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426863488 00000100:00100000:2.0:1787856836.940957:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:2.0:1787856836.940970:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+48:12291:x1874703426863488:12345-192.168.202.6@tcp:36:truncate.0 00010000:00010000:2.0:1787856836.941094:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856836.941132:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c45ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6180 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.941157:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856836.941164:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856836.941459:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.941478:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.941492:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856836.941544:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1787856836.941567:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c5f818a reply state 000000008810f47a transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.941580:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856836.941587:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856836.941590:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787856836.941593:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856836.941719:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+50:12291:x1874703426863488:12345-192.168.202.6@tcp:36:truncate.0 Request processed in 751us (1035us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787856836.941728:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 172 00000020:00080000:2.0:1787856836.941734:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787856837.089425:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856837.089540:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426863616 00000100:00100000:0.0:1787856837.089554:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426863616 00000100:00100000:0.0:1787856837.089653:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00100000:0.0:1787856837.089666:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8215e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+50:12305:x1874703426863616:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:0.0:1787856837.089712:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856837.089739:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c45fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6187 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.089830:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.089847:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.089859:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.089880:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.089887:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.089893:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.089984:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090012:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090019:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856837.090072:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787856837.090076:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856837.090099:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090111:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090119:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090125:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090131:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090137:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856837.090142:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090150:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090161:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856837.090170:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856837.090176:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090182:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4604 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090199:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090204:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090210:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090283:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856837.090286:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090292:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090300:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c793d400) 00010000:00010000:0.0:1787856837.090302:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856837.090305:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090311:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c460b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090342:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c45fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 52 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090368:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 51 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.090375:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856837.090377:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856837.090379:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb800, rc 0) 00000100:00100000:0.0:1787856837.090491:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8215e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+51:12305:x1874703426863616:12345-192.168.202.6@tcp:101:stat.0 Request processed in 828us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856837.090500:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00080000:3.0:1787856837.091812:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856837.186553:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856837.186710:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426863872 00000100:00100000:2.0:1787856837.186743:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426863872 00000100:00100000:2.0:1787856837.187073:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 174 00000100:00100000:2.0:1787856837.187087:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+51:12315:x1874703426863872:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856837.187119:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856837.187149:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a618e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856837.187331:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787856837.187605:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4619 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a618e expref: 53 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.187623:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:2.0:1787856837.187627:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787856837.187633:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a618e expref: 53 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.187653:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ba00, rc 0) 00000100:00100000:2.0:1787856837.188080:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+52:12315:x1874703426863872:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 993us (1539us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1787856837.188091:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 174 00000001:00080000:0.0:1787856837.201787:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:0.0:1787856837.201839:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787856837.201878:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9064c6b7d480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787856837.201884:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065d1914e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9064c6b7d900 00000020:00080000:0.0:1787856837.201888:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065d1914400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9064c7b25600 00000100:00100000:1.0:1787856837.202311:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436368256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787856837.202409:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856837.202513:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436368256 00000100:00100000:1.0:1787856837.202523:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436368256 00000100:00100000:1.0:1787856837.202594:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787856837.202606:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436368256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787856837.202641:0:8409:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1787856837.202708:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9087c3, atime: 0x6a9087c3, ctime: 0x6a9087c3, blocks: 0x8 00010000:00010000:1.0:1787856837.202719:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.202740:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1787856837.202777:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856837.202787:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.202808:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.202821:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.202830:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.202853:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787856837.203182:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3624:x1874703436368256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 578us (772us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787856837.203191:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:1.0:1787856837.203247:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856837.203254:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.203264:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856837.203268:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.203277:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.203312:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.203320:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4627 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.203345:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856837.203347:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856837.203349:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787856837.203359:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787856837.203401:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9066008e0f00/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787856837.203409:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436368256:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1787856837.204033:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787856837.204099:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787856837.204261:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856837.204294:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426864128 00000100:00100000:3.0:1787856837.204301:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426864128 00000100:00100000:3.0:1787856837.204347:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1787856837.204357:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0391c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+21:12315:x1874703426864128:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856837.204584:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0391c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:12315:x1874703426864128:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 229us (326us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1787856837.204593:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00010000:00010000:2.0:1787856837.205478:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205496:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205505:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205535:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.205539:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205547:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205565:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9065d3599a00) 00010000:00010000:2.0:1787856837.205568:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.205574:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205581:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffc00/0xc25410d92a3c448a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205606:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205614:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205620:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205626:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8c00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.205629:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205635:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205655:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856837.205658:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.205662:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205668:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4491 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205707:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205714:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205719:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205724:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.205726:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205731:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205739:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c793d400) 00010000:00010000:2.0:1787856837.205742:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.205745:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205803:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c44d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205832:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205839:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205844:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205850:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215aa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.205853:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205860:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205979:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856837.205983:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.205987:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.205993:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c45d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.206006:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.206012:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.206018:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.206031:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215bc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.206034:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.206040:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.206049:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856837.206051:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.206054:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.206060:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c45f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856837.293063:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856837.293158:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426864384 00000100:00100000:0.0:1787856837.293172:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426864384 00000100:00100000:0.0:1787856837.293315:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 175 00000100:00100000:0.0:1787856837.293327:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:12321:x1874703426864384:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856837.293358:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856837.293386:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c462e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6195 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.293524:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.293565:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 19 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.293576:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.293619:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 19 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.293634:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 19 pid: 9124 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856837.293651:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436368384:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856837.295125:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001600 going to sleep for 11 seconds 00000100:00100000:0.0:1787856837.300832:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436368384:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856837.300875:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856837.300966:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856837.301047:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426864512 00000100:00100000:0.0:1787856837.301055:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426864512 00010000:00010000:0.0:1787856837.301101:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 20 pid: 9124 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856837.301149:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:0.0:1787856837.301161:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+20:2401:x1874703426864512:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856837.301189:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856837.301261:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 20 pid: 9124 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.301275:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 20 pid: 9124 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.301306:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4612 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6187 expref: 20 pid: 9124 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.301324:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856837.301329:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.301341:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.301351:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.301442:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856837.301512:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+19:2401:x1874703426864512:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 352us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856837.301522:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00010000:00010000:1.0:1787856837.302769:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.302785:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856837.302810:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787856837.303067:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c462e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.303089:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.303098:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:1.0:1787856837.303101:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787856837.303122:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba800, rc 0) 00000100:00100000:1.0:1787856837.303354:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+19:12321:x1874703426864384:12345-192.168.202.6@tcp:101:bash.0 Request processed in 10029us (10307us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787856837.303365:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 175 00000100:00100000:3.0:1787856837.322281:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856837.322440:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426864768 00000100:00100000:1.0:1787856837.322454:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426864768 00000100:00100000:1.0:1787856837.322529:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 176 00000100:00100000:1.0:1787856837.322540:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+19:12321:x1874703426864768:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:1.0:1787856837.322873:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.322893:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.322905:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856837.322953:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1787856837.322975:0:8909:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3b58504 reply state 000000006fada610 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.322987:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.322995:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:1.0:1787856837.322997:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787856837.323001:0:8909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787856837.323119:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+22:12321:x1874703426864768:12345-192.168.202.6@tcp:36:bash.0 Request processed in 580us (912us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1787856837.323126:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 176 00000020:00080000:1.0:1787856837.323148:0:8909:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787856837.333625:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856837.333992:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426864896 00000100:00100000:1.0:1787856837.334007:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426864896 00000100:00100000:1.0:1787856837.334089:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 177 00000100:00100000:1.0:1787856837.334102:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:12321:x1874703426864896:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787856837.334134:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856837.334164:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c464a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a619c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.334841:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.334862:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.334885:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.334930:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.334949:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 23 pid: 6497 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856837.334966:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008e3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436368512:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856837.335086:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787856837.338147:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008e3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874703436368512:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856837.338206:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856837.339584:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856837.339844:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426865024 00000100:00100000:0.0:1787856837.339853:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426865024 00010000:00010000:0.0:1787856837.339911:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 24 pid: 6497 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856837.339955:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:0.0:1787856837.339966:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+24:2401:x1874703426865024:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856837.339994:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856837.340002:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 24 pid: 6497 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.340017:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 24 pid: 6497 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.340046:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4635 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6195 expref: 24 pid: 6497 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.340066:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856837.340072:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.340083:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.340092:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.340126:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856837.340201:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+23:2401:x1874703426865024:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 230us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856837.340209:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00010000:00010000:2.0:1787856837.340782:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.340794:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856837.340879:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787856837.340884:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856837.340912:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.340952:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c464a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a619c expref: 23 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.340987:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a619c expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.340996:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856837.340999:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856837.341002:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938000, rc 0) 00000100:00100000:2.0:1787856837.341050:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:12321:x1874703426864896:12345-192.168.202.6@tcp:101:bash.0 Request processed in 6952us (7440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856837.341058:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 177 00000100:00100000:2.0:1787856837.348807:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856837.348916:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426865280 00000100:00100000:3.0:1787856837.348931:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426865280 00000100:00100000:3.0:1787856837.349009:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:3.0:1787856837.349022:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:12321:x1874703426865280:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:3.0:1787856837.349365:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+23:12321:x1874703426865280:12345-192.168.202.6@tcp:35:bash.0 Request processed in 345us (571us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787856837.349373:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:3.0:1787856837.433559:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856837.433682:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426865536 00000100:00100000:1.0:1787856837.433705:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426865536 00000100:00100000:1.0:1787856837.433783:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 178 00000100:00100000:1.0:1787856837.433796:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+23:12331:x1874703426865536:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856837.433830:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856837.433856:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4658 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61a3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856837.433989:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787856837.434121:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4658 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61a3 expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.434139:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:1.0:1787856837.434142:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856837.434148:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4658 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61a3 expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.434164:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938200, rc 0) 00000100:00100000:1.0:1787856837.434306:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:12331:x1874703426865536:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 512us (761us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1787856837.434315:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 178 00000100:00100000:1.0:1787856837.443488:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856837.443600:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426865664 00000100:00100000:3.0:1787856837.443613:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426865664 00000100:00100000:3.0:1787856837.443956:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:3.0:1787856837.443970:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+24:12331:x1874703426865664:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1787856837.444079:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444100:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444114:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444132:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444139:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444145:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444299:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444311:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444319:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787856837.444410:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444427:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444435:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444442:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444449:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856837.444454:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444463:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444478:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:3.0:1787856837.444481:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856837.444488:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444496:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c4666 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444514:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444521:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444534:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444540:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8e00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856837.444543:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444551:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444560:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065d3599000) 00010000:00010000:3.0:1787856837.444562:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856837.444566:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444573:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c466d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444589:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444597:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444603:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444608:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8c00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856837.444611:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444627:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444636:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856837.444639:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856837.444642:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.444648:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4674 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856837.444773:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+24:12331:x1874703426865664:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 805us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856837.444784:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:0.0:1787856837.446854:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856837.446949:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426865920 00000100:00100000:3.0:1787856837.446960:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426865920 00000100:00100000:3.0:1787856837.447037:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1787856837.447053:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+24:12331:x1874703426865920:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856837.447489:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+25:12331:x1874703426865920:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 436us (646us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787856837.447502:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:0.0:1787856837.501026:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856837.501180:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426866176 00000100:00100000:2.0:1787856837.501192:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426866176 00000100:00100000:2.0:1787856837.501299:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 180 00000100:00100000:2.0:1787856837.501310:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+25:12334:x1874703426866176:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856837.501342:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856837.501367:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c467b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501459:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501475:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501487:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501523:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501530:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501536:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501687:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4690 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501709:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4690 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501717:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4690 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856837.501728:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787856837.501841:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501849:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501855:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501861:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.501866:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501887:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.501902:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856837.502014:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.502022:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502030:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4682 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502047:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502054:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502060:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502066:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215ba00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.502068:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502075:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502083:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c793d400) 00010000:00010000:2.0:1787856837.502086:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.502089:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502106:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4689 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502158:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c467b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61aa expref: 28 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502173:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4690 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61aa expref: 27 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.502180:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856837.502183:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856837.502186:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215be00, rc 0) 00000100:00100000:2.0:1787856837.502313:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+27:12334:x1874703426866176:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1005us (1299us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787856837.502322:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 180 00000100:00100000:1.0:1787856837.511487:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856837.511616:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426866304 00000100:00100000:0.0:1787856837.511629:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426866304 00000100:00100000:0.0:1787856837.512868:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1787856837.513041:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+27:2399:x1874703426866304:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856837.513069:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856837.513104:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4690 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61aa expref: 27 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.513127:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856837.513133:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856837.513254:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+26:2399:x1874703426866304:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 317us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856837.513264:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1787856837.519184:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856837.519818:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426866432 00000100:00100000:3.0:1787856837.519832:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426866432 00000100:00100000:3.0:1787856837.519914:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 181 00000100:00100000:3.0:1787856837.519928:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+26:12334:x1874703426866432:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1787856837.520019:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520067:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520082:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520131:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520139:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520147:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520154:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8c00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856837.520159:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520168:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520182:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856837.520186:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856837.520192:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.520199:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c469e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856837.520491:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+26:12334:x1874703426866432:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 566us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856837.520508:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 181 00010000:00010000:0.0:1787856837.521889:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856837.525042:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856837.525458:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426866688 00000100:00100000:0.0:1787856837.525470:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426866688 00000100:00100000:0.0:1787856837.525567:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:0.0:1787856837.525594:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+26:12334:x1874703426866688:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1787856837.527169:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+27:12334:x1874703426866688:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 1581us (2130us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787856837.527182:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:1.0:1787856837.655341:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856837.655566:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426866944 00000100:00100000:3.0:1787856837.655596:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426866944 00000100:00100000:3.0:1787856837.655701:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 182 00000100:00100000:3.0:1787856837.655714:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8281a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+27:12352:x1874703426866944:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:3.0:1787856837.655747:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856837.655775:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61b1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.655933:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c46ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.655961:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c46ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.655976:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c46ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856837.655989:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787856837.656141:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61b1 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.656167:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c46ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61b1 expref: 29 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.656176:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856837.656180:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787856837.656203:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8e00, rc 0) 00000100:00100000:3.0:1787856837.656347:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8281a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+29:12352:x1874703426866944:12345-192.168.202.6@tcp:101:cat.0 Request processed in 636us (1021us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1787856837.656357:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 182 00000100:00100000:2.0:1787856837.686640:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856837.686988:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426867072 00000100:00100000:1.0:1787856837.687001:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426867072 00000100:00100000:1.0:1787856837.687134:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 183 00000100:00100000:1.0:1787856837.687146:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+29:12353:x1874703426867072:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856837.687178:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856837.687204:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c46ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61b8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.687326:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c46c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.687343:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c46c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.687357:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c46c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856837.687411:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787856837.687416:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856837.687438:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c46c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.687470:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c46ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61b8 expref: 31 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.687490:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c46c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61b8 expref: 30 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856837.687499:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:1.0:1787856837.687503:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856837.687507:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939a00, rc 0) 00000100:00100000:1.0:1787856837.687587:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+30:12353:x1874703426867072:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 444us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856837.687603:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 183 00000100:00100000:0.0:1787856837.691558:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856837.691656:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426867456 00000100:00100000:3.0:1787856837.691668:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426867456 00000100:00100000:3.0:1787856837.691761:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1787856837.691774:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+30:12353:x1874703426867456:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856837.692147:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+31:12353:x1874703426867456:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 374us (601us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787856837.692156:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1787856837.694680:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856837.697173:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426867584 00000100:00100000:0.0:1787856837.697194:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426867584 00000100:00100000:0.0:1787856837.697324:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:0.0:1787856837.697337:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+31:12353:x1874703426867584:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:0.0:1787856837.697359:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787856837.697396:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c4651 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a619c expref: 31 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.697447:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c46ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61b1 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.697464:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4547 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6156 expref: 29 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856837.697477:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856837.697483:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856837.697575:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+28:12353:x1874703426867584:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 241us (2915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856837.697583:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1787856837.700375:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856837.700541:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426867712 00000100:00100000:3.0:1787856837.700552:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426867712 00000100:00100000:3.0:1787856837.700627:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 184 00000100:00100000:3.0:1787856837.700638:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+28:12353:x1874703426867712:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:3.0:1787856837.701053:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.701072:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856837.701082:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787856837.701203:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787856837.701437:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+28:12353:x1874703426867712:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 799us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856837.701446:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 184 00000100:00100000:3.0:1787856837.733654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856837.734091:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426867840 00000100:00100000:2.0:1787856837.734106:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426867840 00000100:00100000:2.0:1787856837.734184:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 185 00000100:00100000:2.0:1787856837.734196:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066019992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+28:12355:x1874703426867840:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856837.734260:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856837.734288:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c46cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61bf expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.734614:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.734649:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.734663:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.734979:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.734988:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735154:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735290:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735300:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735308:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856837.735371:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787856837.735376:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856837.735402:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735418:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735442:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735449:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735458:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735465:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.735469:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735478:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735493:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856837.735496:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.735501:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735508:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c46d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735523:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735529:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735535:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735547:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856837.735550:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735557:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735565:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c793d400) 00010000:00010000:2.0:1787856837.735567:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856837.735570:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735576:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c46dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735619:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c46cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735635:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 29 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856837.735642:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:2.0:1787856837.735645:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856837.735647:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a800, rc 0) 00000100:00100000:2.0:1787856837.735763:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066019992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+29:12355:x1874703426867840:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1568us (2124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856837.735773:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 185 00000100:00100000:1.0:1787856838.115342:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.115396:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.115422:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.115454:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.115475:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.115497:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.115530:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426868352 00000100:00100000:1.0:1787856838.115545:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426868352 00000100:00100000:1.0:1787856838.115614:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426868224 00000100:00100000:1.0:1787856838.115617:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426868224 00000100:00100000:1.0:1787856838.115646:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:1.0:1787856838.115657:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426868352:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856838.115764:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:0.0:1787856838.115776:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2399:x1874703426868224:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856838.115826:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2399:x1874703426868224:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 52us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856838.115834:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:1.0:1787856838.115839:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426868352:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 185us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856838.115845:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:1.0:1787856838.115864:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426868096 00000100:00100000:1.0:1787856838.115868:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426868096 00000100:00100000:1.0:1787856838.115903:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426868608 00000100:00100000:1.0:1787856838.115906:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426868608 00000100:00100000:1.0:1787856838.115928:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426868480 00000100:00100000:1.0:1787856838.115931:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426868480 00000100:00100000:1.0:1787856838.115953:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 343 00000100:00100000:1.0:1787856838.115959:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426868096:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856838.115992:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426868096:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 33us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856838.115994:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 344 00000100:00100000:1.0:1787856838.115998:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 343 00000100:00100000:0.0:1787856838.116001:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426868608:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856838.116027:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426868608:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856838.116030:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 345 00000100:00100000:0.0:1787856838.116034:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 344 00000100:00100000:1.0:1787856838.116036:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426868480:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856838.116065:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426868480:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856838.116072:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 345 00000100:00100000:1.0:1787856838.116092:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426867968 00000100:00100000:1.0:1787856838.116096:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426867968 00000100:00100000:1.0:1787856838.116129:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 392 00000100:00100000:1.0:1787856838.116135:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426867968:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856838.116161:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426867968:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856838.116167:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 392 00000100:00080000:1.0:1787856838.116204:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856838.116209:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856838.116211:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856838.116214:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1787856838.225652:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787856838.225671:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787856838.225749:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787856838.225763:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787856838.225973:0:13777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436368640:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787856838.226127:0:13777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c99629c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856838.231632:0:13777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436368640:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787856838.232487:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.232602:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426868736 00000100:00100000:2.0:1787856838.232632:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426868736 00000100:00100000:2.0:1787856838.232820:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 186 00000100:00100000:2.0:1787856838.232832:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+29:12366:x1874703426868736:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787856838.232878:0:9124:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787856838.233039:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+29:12366:x1874703426868736:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 208us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.233047:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 186 00000100:00100000:1.0:1787856838.237184:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856838.237339:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426868864 00000100:00100000:3.0:1787856838.237405:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426868864 00000100:00100000:3.0:1787856838.237506:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:3.0:1787856838.237517:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+29:12366:x1874703426868864:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787856838.237607:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.237626:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.237639:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239599:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239625:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239640:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239697:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239707:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239714:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856838.239817:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787856838.239822:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787856838.239840:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239854:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239861:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239867:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239874:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.239878:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.239887:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240183:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:3.0:1787856838.240188:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856838.240193:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240200:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8000/0xc25410d92a3c46eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240318:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240336:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240341:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240416:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.240420:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240426:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240434:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9065d3599000) 00010000:00010000:3.0:1787856838.240437:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856838.240439:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240445:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c46f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240464:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240470:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240476:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240480:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9e00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.240489:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240495:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240504:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856838.240507:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856838.240509:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.240516:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c46f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856838.241540:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+29:12366:x1874703426868864:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 4014us (4358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.241556:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:2.0:1787856838.247132:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.247260:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426869120 00000100:00100000:1.0:1787856838.247274:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426869120 00000100:00100000:1.0:1787856838.247349:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:1.0:1787856838.247361:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+29:12366:x1874703426869120:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856838.247406:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856838.247433:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c4700 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61c6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247572:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247592:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247606:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856838.247620:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787856838.247888:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247897:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247915:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247921:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856838.247926:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247936:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247953:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:1.0:1787856838.247964:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856838.247971:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.247979:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4707 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.248036:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c4700 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61c6 expref: 31 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.248047:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:1.0:1787856838.248050:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856838.248054:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c4700 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61c6 expref: 31 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.248064:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939c00, rc 0) 00000100:00100000:1.0:1787856838.248142:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+30:12366:x1874703426869120:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 783us (1023us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1787856838.248150:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:3.0:1787856838.272550:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.272653:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426869248 00000100:00100000:2.0:1787856838.272677:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426869248 00000100:00100000:2.0:1787856838.272772:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:2.0:1787856838.272784:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+30:12366:x1874703426869248:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787856838.272837:0:9124:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787856838.273007:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+30:12366:x1874703426869248:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 225us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.273016:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:3.0:1787856838.279786:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.280012:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426869504 00000100:00100000:2.0:1787856838.280027:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426869504 00000100:00100000:2.0:1787856838.280109:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:2.0:1787856838.280122:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+30:12366:x1874703426869504:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856838.280150:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856838.280154:0:8909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787856838.280188:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c46c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61b8 expref: 30 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.280247:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856838.280254:0:8909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856838.280272:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c4715 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61cd expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787856838.281001:0:8909:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787856838.281190:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c471c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.281207:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c471c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.281254:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c471c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.281327:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c4715 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61cd expref: 32 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.281344:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c471c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61cd expref: 31 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.281352:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9064c793db00) 00010000:00010000:2.0:1787856838.281355:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856838.281358:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a600, rc 0) 00000100:00100000:2.0:1787856838.281440:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+31:12366:x1874703426869504:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1320us (1666us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787856838.281450:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:2.0:1787856838.291004:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.293086:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426869760 00000100:00100000:1.0:1787856838.293104:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426869760 00000100:00100000:1.0:1787856838.293189:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00100000:1.0:1787856838.293202:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+31:12366:x1874703426869760:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787856838.293312:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856838.293350:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c471c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61cd expref: 31 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293372:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9064c793db00) 00010000:00010000:1.0:1787856838.293394:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787856838.293425:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293440:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293452:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293467:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293474:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293480:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293538:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293545:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293552:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293559:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939c00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856838.293563:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293571:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293589:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:1.0:1787856838.293592:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856838.293596:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293602:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c472a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293613:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293619:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293624:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293629:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856838.293631:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293637:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293644:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8ef9c5e8 (ffff9065c3c5fe00) 00010000:00010000:1.0:1787856838.293646:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856838.293648:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.293653:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4731 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8ef9c5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856838.293810:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+30:12366:x1874703426869760:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 610us (2819us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787856838.293818:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00100000:1.0:1787856838.301173:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.301248:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426869888 00000100:00100000:1.0:1787856838.301260:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426869888 00000100:00100000:1.0:1787856838.301330:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:1.0:1787856838.301342:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+30:12366:x1874703426869888:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856838.301370:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856838.301399:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4738 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61d4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.301443:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.301460:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.301473:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.301612:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4738 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 32 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.301635:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 31 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.301645:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:1.0:1787856838.301655:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787856838.301660:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938000, rc 0) 00000100:00100000:1.0:1787856838.301756:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+31:12366:x1874703426869888:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 415us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856838.301764:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:1.0:1787856838.308902:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.308951:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426870144 00000100:00100000:1.0:1787856838.308964:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426870144 00000100:00100000:1.0:1787856838.309029:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 193 00000100:00100000:1.0:1787856838.309041:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+31:12366:x1874703426870144:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787856838.309157:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.309179:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.309193:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856838.309435:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1787856838.309447:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372019229118ns, next at 373019225512ns, rc = 0 00000004:00010000:1.0:1787856838.309515:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b0862a1 reply state 00000000e7d61bc8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.309531:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.309540:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:1.0:1787856838.309543:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787856838.309561:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787856838.309698:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+33:12366:x1874703426870144:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 658us (810us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787856838.309707:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 193 00000100:00100000:1.0:1787856838.315561:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856838.316318:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426870272 00000100:00100000:3.0:1787856838.316333:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426870272 00000100:00100000:3.0:1787856838.316414:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:3.0:1787856838.316427:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+33:12366:x1874703426870272:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787856838.316458:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856838.316485:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61db expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.316559:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 34 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.316577:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 34 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.316614:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856838.316618:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787856838.316622:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9e00, rc 0) 00000100:00100000:3.0:1787856838.316848:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+34:12366:x1874703426870272:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 423us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856838.316856:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:1.0:1787856838.324042:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856838.324131:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426870400 00000100:00100000:0.0:1787856838.324144:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426870400 00000100:00100000:0.0:1787856838.324261:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1787856838.324273:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426870400:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787856838.324588:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426870400:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 317us (561us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787856838.324597:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:1.0:1787856838.334157:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856838.334272:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426870656 00000100:00100000:3.0:1787856838.334286:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426870656 00000100:00100000:3.0:1787856838.334357:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:3.0:1787856838.334369:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+34:12366:x1874703426870656:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787856838.334694:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+35:12366:x1874703426870656:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 327us (551us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787856838.334703:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:3.0:1787856838.345034:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.347818:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426870912 00000100:00100000:1.0:1787856838.347841:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426870912 00000100:00100000:1.0:1787856838.348158:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 195 00000100:00100000:1.0:1787856838.348171:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601998780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+35:12366:x1874703426870912:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787856838.348338:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601998780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+35:12366:x1874703426870912:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 169us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856838.348346:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 195 00000100:00100000:1.0:1787856838.352870:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856838.352994:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426871040 00000100:00100000:0.0:1787856838.353007:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426871040 00000100:00100000:0.0:1787856838.353078:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:0.0:1787856838.353089:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+35:12366:x1874703426871040:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856838.353114:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856838.353142:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4754 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61e2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.353258:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c475b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.353276:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c475b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.353290:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c475b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856838.353349:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856838.353372:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c475b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.353403:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4754 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e2 expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.353437:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c475b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e2 expref: 36 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.353446:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856838.353450:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787856838.353454:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007baa00, rc 0) 00000100:00100000:0.0:1787856838.353526:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+36:12366:x1874703426871040:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 438us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856838.353533:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:1.0:1787856838.359871:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.360001:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426871168 00000100:00100000:2.0:1787856838.360015:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426871168 00000100:00100000:2.0:1787856838.360083:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1787856838.360094:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426871168:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856838.360121:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856838.360147:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61e9 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856838.360181:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9087c6, blocks: 0x0 00010000:00010000:2.0:1787856838.360206:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1787856838.360212:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856838.360241:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.360265:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.360281:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b800, rc 0) 00000100:00100000:2.0:1787856838.363111:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426871168:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3001us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.363127:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1787856838.365402:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.365676:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426871424 00000100:00100000:2.0:1787856838.365698:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426871424 00000100:00100000:2.0:1787856838.365777:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:2.0:1787856838.365788:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+36:12366:x1874703426871424:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787856838.366120:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+36:12366:x1874703426871424:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 333us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.366130:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:3.0:1787856838.379837:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.380179:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426871552 00000100:00100000:2.0:1787856838.380193:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426871552 00000100:00100000:2.0:1787856838.380287:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:2.0:1787856838.380299:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+8:12366:x1874703426871552:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856838.380323:0:10490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856838.380347:0:10490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61f0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.380391:0:10490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 9 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.380403:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856838.380408:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856838.380415:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 9 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.380457:0:10490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 9 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.380473:0:10490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 9 pid: 8410 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856838.380489:0:10490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436368768:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856838.380629:0:10490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890180 going to sleep for 11 seconds 00000100:00100000:2.0:1787856838.382675:0:10490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436368768:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856838.382737:0:10490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 9 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.382765:0:10490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b000, rc 0) 00000100:00100000:2.0:1787856838.382869:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+9:12366:x1874703426871552:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 2571us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.382881:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1787856838.390072:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.390209:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426871680 00000100:00100000:1.0:1787856838.390246:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426871680 00010000:00010000:1.0:1787856838.390306:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 9 pid: 8410 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856838.390354:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:1.0:1787856838.390365:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+9:2402:x1874703426871680:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856838.390386:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856838.390414:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 9 pid: 8410 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.390451:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 9 pid: 8410 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.390484:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4762 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e9 expref: 9 pid: 8410 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.390509:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856838.390513:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856838.390524:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.390537:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.390588:0:8425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856838.390606:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d01661c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8425:1874703436368896:192.168.202.6@tcp:105: 00000100:00100000:1.0:1787856838.391007:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856838.396848:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d01661c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8425:1874703436368896:192.168.202.6@tcp:105: 00010000:00010000:3.0:1787856838.396885:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856838.396973:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426871680:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 6608us (6918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856838.396987:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:0.0:1787856838.411689:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.412451:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426871808 00000100:00100000:2.0:1787856838.412466:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426871808 00002000:00100000:2.0:1787856838.412538:0:8414:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9066007f0780 x1874703426871808/t0(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:239/0 lens 504/0 e 0 to 0 dl 1787856849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787856838.412552:0:8414:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9066007f0780 with x1874703426871808 ext(0->8) 00002000:00010000:2.0:1787856838.412558:0:8414:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9066007f0780 00000100:00100000:2.0:1787856838.412629:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1787856838.412640:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426871808:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787856838.414264:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:898e91b3-529b-44bc-a821-726bff6c71d4+10:2402:x1874703426871808:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 1613us (2594us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787856838.414280:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00002000:00100000:2.0:1787856838.414295:0:8414:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9066007f0780 x1874703426871808/t4294967315(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:239/0 lens 504/448 e 0 to 0 dl 1787856849 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787856838.414305:0:8414:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9066007f0780 with x1874703426871808 ext(0->8) 00002000:00010000:2.0:1787856838.414311:0:8414:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9066007f0780 00000100:00100000:1.0:1787856838.428037:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.428118:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426871936 00000100:00100000:2.0:1787856838.428131:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426871936 00000100:00100000:2.0:1787856838.428208:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:2.0:1787856838.428259:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d01661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+36:12366:x1874703426871936:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787856838.435614:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787856838.435634:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:3.0:1787856838.435774:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435789:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435814:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435823:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.435843:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435854:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435875:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856838.435879:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856838.435884:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435892:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4643 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435916:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435924:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435930:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435936:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.435940:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435958:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435969:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856838.435971:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787856838.435975:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.435982:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4746 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856838.436549:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436369024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787856838.436623:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856838.436890:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436369024 00000100:00100000:3.0:1787856838.436899:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436369024 00000100:00100000:3.0:1787856838.436959:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787856838.436970:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436369024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787856838.437101:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787856838.437105:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787856838 00002000:00010000:3.0:1787856838.437108:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787856838.437111:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787856838 -> 1787856838 00002000:00010000:3.0:1787856838.437113:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787856838.437156:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436369024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (533us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787856838.437165:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787856838.437187:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787856838.437254:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9064c82152c0/2, rc 0, transno 4294967316 00000100:00100000:3.0:1787856838.437261:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436369024:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787856838.437562:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787856838.437949:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787856838.437961:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787856838.438028:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d01661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+19:12366:x1874703426871936:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 9805us (10001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.438039:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:0.0:1787856838.446078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856838.446182:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426872064 00000100:00100000:3.0:1787856838.446199:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426872064 00000100:00100000:3.0:1787856838.446297:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1787856838.446308:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+10:2401:x1874703426872064:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787856838.464296:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1787856838.464313:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1787856838.464431:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426872064:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 18119us (18363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.464442:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1787856838.469625:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856838.470055:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426872320 00000100:00100000:0.0:1787856838.470069:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426872320 00000100:00100000:0.0:1787856838.470132:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 199 00000100:00100000:0.0:1787856838.470143:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+19:12366:x1874703426872320:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787856838.470214:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856838.470281:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c475b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61e2 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.470298:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856838.470303:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856838.470345:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.470362:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.470380:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856838.470540:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056f3ccf1 reply state 000000004c365167 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.470553:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.470559:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:0.0:1787856838.470561:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856838.470564:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856838.470709:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+20:12366:x1874703426872320:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 566us (1097us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1787856838.470726:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 199 00000040:00080000:1.0:1787856838.474627:0:14637:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787856838.474641:0:14637:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787856838.474671:0:14637:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787856838.474691:0:14637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787856838.478598:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856838.482618:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426872448 00000100:00100000:3.0:1787856838.482634:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426872448 00000100:00100000:3.0:1787856838.482726:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1787856838.482739:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7bec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426872448:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787856838.482964:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787856838.482969:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787856838 -> 1787856837 00002000:00010000:3.0:1787856838.482972:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787856835 00002000:00010000:3.0:1787856838.482974:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787856838 -> 1787856837 00002000:00010000:3.0:1787856838.482977:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787856838.483168:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7bec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426872448:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 431us (4583us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787856838.483178:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:2.0:1787856838.489465:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.489587:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426872704 00000100:00100000:2.0:1787856838.489597:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426872704 00000100:00100000:2.0:1787856838.489653:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:2.0:1787856838.489663:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+20:12366:x1874703426872704:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787856838.489742:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.489760:0:9124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.489770:0:9124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.489820:0:9124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.489835:0:9124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 20 pid: 6497 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856838.489852:0:9124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436369152:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856838.489948:0:9124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856838.504628:0:9124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436369152:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856838.504743:0:9124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856838.505061:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856838.505202:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426872832 00000100:00100000:3.0:1787856838.505212:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426872832 00010000:00010000:3.0:1787856838.505303:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 21 pid: 6497 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856838.505349:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:3.0:1787856838.505362:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+21:2401:x1874703426872832:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856838.505382:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856838.505391:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 21 pid: 6497 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.505405:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 21 pid: 6497 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.505435:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c473f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61d4 expref: 21 pid: 6497 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.505456:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856838.505462:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.505473:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.505482:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.505504:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856838.505571:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+20:2401:x1874703426872832:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 211us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856838.505579:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00010000:00010000:2.0:1787856838.505984:0:9124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.506046:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.506098:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.506107:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.506115:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.506123:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215aa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856838.506129:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.506138:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.506170:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856838.506174:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787856838.506179:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.506186:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4777 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856838.506402:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+19:12366:x1874703426872704:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 16737us (16946us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787856838.506413:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:3.0:1787856838.509147:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856838.509307:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426872960 00000100:00100000:0.0:1787856838.509323:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426872960 00000100:00100000:0.0:1787856838.509432:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1787856838.509444:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426872960:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787856838.509508:0:10490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.509532:0:10490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.509542:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856838.509547:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856838.509552:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.509611:0:10490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.509628:0:10490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 8 pid: 10490 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856838.509648:0:10490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436369280:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856838.509789:0:10490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001600 going to sleep for 11 seconds 00000100:00100000:2.0:1787856838.523256:0:10490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436369280:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856838.523309:0:10490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856838.523380:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856838.523676:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426873088 00000100:00100000:2.0:1787856838.523695:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426873088 00010000:00010000:2.0:1787856838.523742:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 9 pid: 10490 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856838.523799:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:2.0:1787856838.523812:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+9:2401:x1874703426873088:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856838.523834:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856838.523864:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 9 pid: 10490 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.523902:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 9 pid: 10490 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.523936:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b00e69e5/0xc25410d92a3c4769 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f0 expref: 9 pid: 10490 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.523957:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787856838.523962:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787856838.523968:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.523978:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.524055:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856838.524146:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+8:2401:x1874703426873088:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 336us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.524156:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 90 00010000:00010000:3.0:1787856838.528005:0:10490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.528029:0:10490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.528070:0:10490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.528079:0:10490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.528089:0:10490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.528096:0:10490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007baa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856838.528102:0:10490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.528113:0:10490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.528139:0:10490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.528148:0:10490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c477e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856838.528852:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426872960:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 19398us (19701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.528867:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:1.0:1787856838.537695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856838.537772:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426873344 00000100:00100000:0.0:1787856838.537789:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426873344 00000100:00100000:0.0:1787856838.537871:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 201 00000100:00100000:0.0:1787856838.537886:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+19:12366:x1874703426873344:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787856838.538000:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.538024:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.538035:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.538084:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.538099:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 19 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856838.538134:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436369408:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856838.538287:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001480 going to sleep for 11 seconds 00000100:00100000:1.0:1787856838.540140:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436369408:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856838.540179:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856838.540556:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856838.543949:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426873472 00000100:00100000:0.0:1787856838.543974:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426873472 00010000:00010000:0.0:1787856838.544052:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 20 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856838.544109:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:0.0:1787856838.544121:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+20:2401:x1874703426873472:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856838.544142:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856838.544150:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 20 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.544166:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 20 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.544194:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c45cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6179 expref: 20 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.544231:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:0.0:1787856838.544239:0:13166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.544251:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.544280:0:13166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856838.544633:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856838.544726:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+19:2401:x1874703426873472:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 606us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856838.544737:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00010000:00010000:3.0:1787856838.549416:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.549442:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.549616:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856838.549907:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.549933:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 19 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.549961:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.550023:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 19 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856838.550044:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 19 pid: 9124 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856838.550061:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436369536:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856838.550186:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856838.560250:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436369536:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856838.560294:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856838.563344:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856838.563429:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426873600 00000100:00100000:3.0:1787856838.563442:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426873600 00010000:00010000:3.0:1787856838.563501:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 20 pid: 9124 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856838.563558:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:3.0:1787856838.563570:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+20:2402:x1874703426873600:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856838.563589:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856838.563597:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 20 pid: 9124 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.563612:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 20 pid: 9124 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.563643:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c474d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61db expref: 20 pid: 9124 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.563690:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856838.563697:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.563708:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.563717:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.563751:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856838.563817:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+19:2402:x1874703426873600:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 249us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856838.563825:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00010000:00010000:3.0:1787856838.563931:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.563940:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787856838.564080:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787856838.564210:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1787856838.564452:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1787856838.564547:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8362940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8909:1874703436369664:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787856838.565855:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856838.565912:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c12edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856838.566085:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436369664 00000100:00100000:2.0:1787856838.566095:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436369664 00000100:00100000:2.0:1787856838.566157:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787856838.566167:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8909:x1874703436369664:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787856838.566308:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8909:x1874703436369664:12345-0@lo:1000:mdt00_003.0 Request processed in 142us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856838.566316:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787856838.567743:0:8909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787856838.567755:0:8909:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9064c82152c0, transno 4294967316 00000100:00100000:3.0:1787856838.567814:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8362940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8909:1874703436369664:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787856838.568036:0:8909:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1787856838.568142:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8362940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8909:1874703436369792:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787856838.568204:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856838.569805:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856838.572362:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436369792 00000100:00100000:2.0:1787856838.572378:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436369792 00000100:00100000:2.0:1787856838.572452:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787856838.572463:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8909:x1874703436369792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787856838.572724:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8909:x1874703436369792:12345-0@lo:1000:mdt00_003.0 Request processed in 262us (4518us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787856838.572732:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787856838.574844:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8362940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8909:1874703436369792:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787856838.574925:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.574937:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.574946:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.574952:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215aa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.574959:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.574968:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.574990:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856838.574993:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787856838.575000:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575007:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c478c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575041:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575056:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575063:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575068:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8c00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.575072:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575078:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575088:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856838.575090:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787856838.575094:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575099:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c46c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575129:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575146:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575156:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575201:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.575246:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 22 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856838.575265:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83630c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436369920:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787856838.575375:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856838.580847:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856838.580929:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426873728 00000100:00100000:1.0:1787856838.580942:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426873728 00010000:00010000:1.0:1787856838.580997:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 23 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856838.581050:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:1.0:1787856838.581061:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+23:2401:x1874703426873728:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856838.581082:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856838.581091:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 23 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.581106:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 23 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.581139:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:1.0:1787856838.581146:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.581157:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.581183:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856838.581207:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856838.581320:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+23:2401:x1874703426873728:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 260us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856838.581329:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 93 00010000:00010000:3.0:1787856838.581614:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a800/0xc25410d92a3c46e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61bf expref: 22 pid: 6498 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856838.581633:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83630c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436369920:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856838.581663:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581673:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581690:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581705:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581712:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581719:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581726:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8e00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.581739:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581748:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581759:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856838.581763:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856838.581766:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581773:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4793 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581786:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581793:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581800:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581806:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856838.581815:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581822:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581829:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065d3599f00) 00010000:00010000:3.0:1787856838.581832:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787856838.581842:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.581848:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4785 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856838.582190:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787856838.582197:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787856838.582705:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787856838.582718:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787856838.582946:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+21:12366:x1874703426873344:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 45060us (45263us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787856838.582961:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 201 00000020:00080000:3.0:1787856838.582970:0:8909:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787856838.597087:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856838.604854:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426873984 00000100:00100000:3.0:1787856838.604874:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426873984 00000100:00100000:3.0:1787856838.604969:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:3.0:1787856838.604983:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0392450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+21:12366:x1874703426873984:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787856838.605373:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787856838.605415:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1787856838.605456:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.605476:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.605492:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.605501:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.605509:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.605516:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.605546:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787856838.606297:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0392450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+23:12366:x1874703426873984:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 1310us (9219us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787856838.606312:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000020:00080000:3.0:1787856838.606320:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787856838.606400:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856838.606409:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.606419:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c8c00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856838.606424:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.606433:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.606450:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:3.0:1787856838.606454:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787856838.606461:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.606468:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c479a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856838.606485:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856838.606487:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856838.606488:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856839.570462:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856840.018802:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436370176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856840.018972:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436370304:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.019037:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.019105:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436370816:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.019136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.019621:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436371328:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.019653:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.019684:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436371840:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.019710:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.019739:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787856840.019745:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436370432:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.019771:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.019788:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436370944:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.019809:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.019825:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436371456:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.019878:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856840.020123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856840.020166:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436370688:0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.020202:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436370560:0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.020247:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856840.020268:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436371072:0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.020303:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436370816 00000100:00100000:2.0:1787856840.020313:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436370816 00000100:00100000:2.0:1787856840.020356:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436370560 00000100:00100000:2.0:1787856840.020359:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436370560 00000100:00100000:2.0:1787856840.020387:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787856840.020397:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436370816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.021178:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436371968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856840.021231:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.021281:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436370304 00000100:00100000:1.0:1787856840.021287:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436370304 00000100:00100000:1.0:1787856840.021329:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787856840.021337:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436370304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.021406:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436370304:12345-0@lo:400:kworker.0 Request processed in 69us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856840.021514:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436370176 00000100:00100000:0.0:1787856840.021520:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436370176 00000100:00100000:0.0:1787856840.021568:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436371968 00000100:00100000:0.0:1787856840.021571:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436371968 00000100:00100000:0.0:1787856840.021588:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787856840.021595:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436370176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856840.021623:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787856840.021664:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436370176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856840.022616:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787856840.023530:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787856840.023555:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436371968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856840.023586:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787856840.024127:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436370816:12345-0@lo:400:kworker.0 Request processed in 3728us (4987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.024139:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787856840.024185:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787856840.024196:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436370560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.024248:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436370560:12345-0@lo:400:kworker.0 Request processed in 56us (4001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.024254:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787856840.024288:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436371328 00000100:00100000:2.0:1787856840.024296:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436371328 00000100:00100000:2.0:1787856840.024347:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436371840 00000100:00100000:2.0:1787856840.024350:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436371840 00000100:00100000:2.0:1787856840.024384:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436370944 00000100:00100000:2.0:1787856840.024387:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436370944 00000100:00100000:2.0:1787856840.024405:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787856840.024994:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436371968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1449us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856840.025004:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1787856840.025037:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856840.025043:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856840.025788:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787856840.025871:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787856840.026086:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436371840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856840.027117:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856840.027233:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436371584:0@lo:400:kworker.0 00000100:00100000:0.0:1787856840.027294:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856840.027318:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436370048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856840.027345:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856840.027403:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436370560:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.027573:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436371840:12345-0@lo:400:kworker.0 Request processed in 1692us (7860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856840.027585:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787856840.027623:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787856840.027634:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066019983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436370944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.027697:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066019983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436370944:12345-0@lo:400:kworker.0 Request processed in 68us (7887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856840.027703:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787856840.027726:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436370048 00000100:00100000:1.0:1787856840.027734:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436370048 00000100:00100000:1.0:1787856840.027768:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787856840.027775:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436370048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856840.027795:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787856840.027997:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436371328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.028038:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436371328:12345-0@lo:400:kworker.0 Request processed in 3628us (8385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.028045:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787856840.028088:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436370432 00000100:00100000:2.0:1787856840.028092:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436370432 00000100:00100000:2.0:1787856840.028131:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436371456 00000100:00100000:2.0:1787856840.028134:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436371456 00000100:00100000:2.0:1787856840.028163:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436371072 00000100:00100000:2.0:1787856840.028166:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436371072 00000100:00100000:2.0:1787856840.028177:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436371584 00000100:00100000:2.0:1787856840.028179:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436371584 00000100:00100000:2.0:1787856840.028193:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787856840.028199:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660199bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436370432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.028251:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660199bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436370432:12345-0@lo:400:kworker.0 Request processed in 52us (8479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.028258:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787856840.028270:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787856840.028275:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436371456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.028307:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436371456:12345-0@lo:400:kworker.0 Request processed in 32us (8429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.028313:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787856840.028326:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787856840.028331:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436371072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.028359:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436371072:12345-0@lo:400:kworker.0 Request processed in 28us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.028373:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787856840.028385:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787856840.028391:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436371584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.030102:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436370048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856840.030135:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787856840.038202:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436371072:0@lo:400:kworker.0 00000100:00100000:0.0:1787856840.038267:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436370048:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787856840.038344:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856840.038352:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856840.039166:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436370432:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039188:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436370944:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039202:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436371456:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039251:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436371968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856840.039268:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436370304:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039283:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436370816:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039297:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436371328:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039309:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436371840:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039425:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.039488:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436371200:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039562:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.039588:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436371712:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.039614:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856840.039660:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436370176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856840.039696:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436370688 00000100:00100000:1.0:1787856840.039704:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436370688 00000100:00100000:1.0:1787856840.039752:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436371200 00000100:00100000:1.0:1787856840.039755:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436371200 00000100:00100000:1.0:1787856840.039783:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787856840.039793:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436370688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.040145:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436370688:12345-0@lo:400:kworker.0 Request processed in 352us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856840.040155:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787856840.040177:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787856840.040184:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436371200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.040213:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436371200:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856840.040242:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:1.0:1787856840.040263:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856840.040274:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436371712 00000100:00100000:1.0:1787856840.040278:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436371712 00000100:00100000:1.0:1787856840.040308:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787856840.040314:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436371712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.040347:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436371712:12345-0@lo:400:kworker.0 Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856840.040353:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787856840.040556:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436370688:0@lo:400:kworker.0 00010000:00080000:1.0:1787856840.040574:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826d2c0 x1874703436371200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856840.040586:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436371200:0@lo:400:kworker.0 00000100:00100000:1.0:1787856840.040596:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436371712:0@lo:400:kworker.0 00000100:00100000:2.0:1787856840.040809:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436371584:12345-0@lo:400:kworker.0 Request processed in 12415us (13510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.040819:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00080000:0.0:1787856840.042975:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a78b40 x1874703436371584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856840.043001:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436371584:0@lo:400:kworker.0 00000100:00100000:0.0:1787856840.530362:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066007f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436372096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856840.530461:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856840.530689:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436372096 00000100:00100000:3.0:1787856840.530699:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436372096 00000100:00100000:3.0:1787856840.530781:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787856840.530809:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1874703436372096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856840.530841:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856840.531532:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1874703436372096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 724us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856840.531543:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787856840.531609:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066007f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436372096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856840.594911:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787856840.601768:0:14688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787856840.601782:0:14688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787856840.601814:0:14688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787856840.601823:0:14688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787856840.746839:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856840.750986:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426874240 00000100:00100000:0.0:1787856840.751011:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426874240 00000100:00080000:1.0:1787856840.751074:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856840.751197:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:0.0:1787856840.751211:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+23:12384:x1874703426874240:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856840.751263:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856840.751289:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c47a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61f7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.751428:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c47a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.751470:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c47a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.751485:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c47a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856840.751500:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787856840.751632:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c47a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f7 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.751653:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c47a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f7 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.751673:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856840.751676:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787856840.751680:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba200, rc 0) 00000100:00100000:0.0:1787856840.751776:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+25:12384:x1874703426874240:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 568us (4951us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787856840.751785:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:3.0:1787856840.755100:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856840.755292:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426874368 00000100:00100000:0.0:1787856840.755307:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426874368 00000100:00100000:0.0:1787856840.755391:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 203 00000100:00100000:0.0:1787856840.755403:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+25:12384:x1874703426874368:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1787856840.755508:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755528:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755555:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755574:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755581:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755588:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755696:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755706:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755713:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856840.755771:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755787:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755794:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755802:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755818:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856840.755823:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755832:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755847:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856840.755850:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856840.755856:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755863:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c47b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755879:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755885:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755891:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755896:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856840.755899:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755904:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755922:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c5b79800) 00010000:00010000:0.0:1787856840.755924:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856840.755928:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755934:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c47bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755954:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755960:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755966:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755971:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856840.755974:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755979:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755986:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9065c5b79b00) 00010000:00010000:0.0:1787856840.755989:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856840.755992:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856840.755998:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c47c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856840.756114:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+25:12384:x1874703426874368:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 711us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856840.756123:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 203 00000100:00100000:2.0:1787856840.831265:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856840.831308:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426874624 00000100:00100000:2.0:1787856840.831320:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426874624 00000100:00100000:2.0:1787856840.831384:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:2.0:1787856840.831395:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+25:12388:x1874703426874624:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856840.831426:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856840.831453:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c47cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a61fe expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831564:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831582:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831610:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831628:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831635:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831642:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831817:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831825:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831832:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856840.831844:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787856840.831950:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831958:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831965:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831971:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856840.831983:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.831992:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832006:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856840.832010:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856840.832014:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832022:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c47d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832038:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832045:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832051:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832056:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856840.832059:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832065:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832072:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c73f6800) 00010000:00010000:2.0:1787856840.832074:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856840.832084:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832091:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832139:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c47cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 28 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832153:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 27 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.832161:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:2.0:1787856840.832163:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856840.832165:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b200, rc 0) 00000100:00100000:2.0:1787856840.832269:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+27:12388:x1874703426874624:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 874us (1016us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787856840.832276:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:1.0:1787856840.861781:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856840.861822:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426874752 00000100:00100000:1.0:1787856840.861833:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426874752 00000100:00100000:1.0:1787856840.861916:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:1.0:1787856840.861928:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+27:12388:x1874703426874752:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1787856840.862020:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862040:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862055:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862100:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862108:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862115:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862122:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856840.862127:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862135:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862148:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:1.0:1787856840.862151:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856840.862157:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.862175:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c47ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856840.862294:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+27:12388:x1874703426874752:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 367us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856840.862302:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:3.0:1787856840.873962:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856840.874008:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426875008 00000100:00100000:3.0:1787856840.874023:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426875008 00000100:00100000:3.0:1787856840.874097:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:3.0:1787856840.874110:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+27:12388:x1874703426875008:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856840.874435:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+28:12388:x1874703426875008:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 327us (488us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787856840.874444:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1787856840.946355:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856840.948156:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426875264 00000100:00100000:2.0:1787856840.948178:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426875264 00000100:00100000:2.0:1787856840.948597:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:2.0:1787856840.948613:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+28:11912:x1874703426875264:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856840.948649:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856840.948689:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c47f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6205 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.948842:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.948883:0:9124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 29 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.948895:0:9124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.948943:0:9124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 29 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.948960:0:9124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 29 pid: 8909 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856840.948977:0:9124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cda40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436372224:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856840.949177:0:9124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890780 going to sleep for 11 seconds 00000100:00100000:3.0:1787856840.953352:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856840.953486:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426875392 00000100:00100000:1.0:1787856840.953498:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426875392 00010000:00010000:1.0:1787856840.953556:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 30 pid: 8909 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856840.953607:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:1.0:1787856840.953619:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+30:2401:x1874703426875392:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856840.953638:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856840.953647:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 30 pid: 8909 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.953676:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 30 pid: 8909 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.953706:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:1.0:1787856840.953713:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.953723:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.953757:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.953783:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856840.953860:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+30:2401:x1874703426875392:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 242us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856840.953870:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 94 00010000:00010000:2.0:1787856840.955338:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c47e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61fe expref: 29 pid: 8909 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856840.955371:0:9124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cda40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436372224:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856840.955404:0:9124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.955416:0:9124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.955422:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856840.955531:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787856840.956046:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c47f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 30 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.956065:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 29 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.956075:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:2.0:1787856840.956078:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787856840.956082:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a000, rc 0) 00000100:00100000:2.0:1787856840.956271:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+29:11912:x1874703426875264:12345-192.168.202.6@tcp:101:bash.0 Request processed in 7661us (10068us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787856840.956281:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:3.0:1787856840.966323:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856840.966492:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426875520 00000100:00100000:2.0:1787856840.966506:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426875520 00000100:00100000:2.0:1787856840.966592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:2.0:1787856840.966605:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+29:11912:x1874703426875520:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856840.966641:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856840.966680:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c480a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a620c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.966726:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4811 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.966744:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.966771:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.966945:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c480a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a620c expref: 31 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.966968:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a620c expref: 30 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.966978:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:2.0:1787856840.966982:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787856840.966987:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b200, rc 0) 00000100:00100000:2.0:1787856840.967075:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+30:11912:x1874703426875520:12345-192.168.202.6@tcp:101:bash.0 Request processed in 472us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.967083:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:3.0:1787856840.973584:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856840.973712:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426875776 00000100:00100000:1.0:1787856840.973727:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426875776 00000100:00100000:1.0:1787856840.973808:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00100000:1.0:1787856840.973820:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+30:11912:x1874703426875776:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:1.0:1787856840.974157:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.974181:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.974196:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856840.974408:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1787856840.974437:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3d2af55 reply state 000000006816b190 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.974453:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856840.974463:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:1.0:1787856840.974466:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787856840.974492:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787856840.974540:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1787856840.974675:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+34:11912:x1874703426875776:12345-192.168.202.6@tcp:36:bash.0 Request processed in 855us (1105us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787856840.974684:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 208 00000020:00080000:1.0:1787856840.974691:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787856840.989548:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856840.989828:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426875904 00000100:00100000:2.0:1787856840.989843:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426875904 00000100:00100000:2.0:1787856840.989940:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:2.0:1787856840.989953:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+34:11912:x1874703426875904:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856840.989987:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856840.990018:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c481f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6213 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.990100:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c481f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6213 expref: 35 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.990119:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c481f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6213 expref: 35 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.990170:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:2.0:1787856840.990174:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787856840.990181:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ae00, rc 0) 00000100:00100000:2.0:1787856840.990579:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+35:11912:x1874703426875904:12345-192.168.202.6@tcp:101:bash.0 Request processed in 627us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.990588:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:3.0:1787856840.993033:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856840.993182:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426876032 00000100:00100000:2.0:1787856840.993194:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426876032 00000100:00080000:1.0:1787856840.993315:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856840.993365:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1787856840.993378:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:11912:x1874703426876032:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1787856840.993403:0:10490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856840.993431:0:10490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a621a expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856840.993477:0:10490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9087c5, atime: 0x6a9087c3, ctime: 0x6a9087c5, blocks: 0x8 00010000:00010000:2.0:1787856840.993510:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1787856840.993516:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856840.993527:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.993547:0:10490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856840.993560:0:10490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215aa00, rc 0) 00000100:00100000:2.0:1787856840.993633:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+8:11912:x1874703426876032:12345-192.168.202.6@tcp:101:bash.0 Request processed in 257us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856840.993671:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:3.0:1787856840.995313:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856840.995382:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426876160 00000100:00100000:1.0:1787856840.995391:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426876160 00002000:00010000:1.0:1787856840.995451:0:8413:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1787856840.995457:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9065d9e60780 with x1874703426876160 ext(0->18446744073709551615) 00002000:00010000:1.0:1787856840.995471:0:8413:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9065d9e60780. 00000100:00100000:1.0:1787856840.995765:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1787856840.995778:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+8:2401:x1874703426876160:12345-192.168.202.6@tcp:10:bash.0 00002000:00010000:1.0:1787856840.996090:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787856840.996094:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787856837 -> 1787856841 00002000:00010000:1.0:1787856840.996096:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787856835 -> 1787856835 00002000:00010000:1.0:1787856840.996098:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787856837 -> 1787856841 00002000:00010000:1.0:1787856840.996100:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787856840.996157:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+9:2401:x1874703426876160:12345-192.168.202.6@tcp:10:bash.0 Request processed in 382us (863us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787856840.996164:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00002000:00010000:1.0:1787856840.996169:0:8413:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1787856840.996172:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9065d9e60780 with x1874703426876160 ext(0->18446744073709551615) 00002000:00010000:1.0:1787856840.996891:0:8413:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9065d9e60780. 00000100:00100000:2.0:1787856841.041567:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436372352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856841.041688:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856841.042536:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436372352 00000100:00100000:1.0:1787856841.042550:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436372352 00000100:00100000:1.0:1787856841.043179:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787856841.043211:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436372352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856841.043299:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787856841.043399:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436372352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 192us (1711us total) trans 0 rc 0/0 00000001:00080000:0.0:1787856841.044928:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787856841.044948:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1787856841.045671:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436372352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856841.047806:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787856841.095290:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.095415:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426876288 00000100:00100000:2.0:1787856841.095428:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426876288 00000100:00100000:2.0:1787856841.095510:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:2.0:1787856841.095524:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+35:12402:x1874703426876288:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1787856841.095623:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095647:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095672:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095692:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095700:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095706:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095807:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095818:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095850:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856841.095913:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095926:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095932:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095939:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095946:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856841.095952:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095960:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095973:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856841.095977:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856841.095982:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.095988:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c482d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096003:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096017:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096023:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096028:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215bc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856841.096032:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096039:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096048:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c73f6c00) 00010000:00010000:2.0:1787856841.096051:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856841.096054:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096061:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4834 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096079:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096086:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096092:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096097:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856841.096106:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096113:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096122:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:2.0:1787856841.096124:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856841.096127:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.096133:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c483b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856841.096300:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+35:12402:x1874703426876288:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 778us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856841.096310:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:3.0:1787856841.170718:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.170850:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426876544 00000100:00100000:1.0:1787856841.170861:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426876544 00000100:00100000:1.0:1787856841.170938:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:1.0:1787856841.170950:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+35:12405:x1874703426876544:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856841.170989:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856841.171015:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4842 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6221 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171100:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171116:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171130:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171147:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171155:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171164:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171335:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4857 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171345:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171353:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856841.171361:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787856841.171442:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171450:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171457:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171464:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938a00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856841.171468:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171475:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171488:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:1.0:1787856841.171491:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856841.171496:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171513:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4849 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171527:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171533:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171539:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171544:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856841.171546:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171553:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171560:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c3c5fe00) 00010000:00010000:1.0:1787856841.171563:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856841.171565:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171571:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4850 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171610:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4842 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6221 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171623:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4857 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6221 expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.171636:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:1.0:1787856841.171638:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787856841.171640:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938200, rc 0) 00000100:00100000:1.0:1787856841.172118:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+37:12405:x1874703426876544:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1168us (1407us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787856841.172127:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:3.0:1787856841.181728:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.182467:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426876672 00000100:00100000:2.0:1787856841.182479:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426876672 00000100:00100000:2.0:1787856841.182589:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:2.0:1787856841.182600:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+37:12405:x1874703426876672:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1787856841.182693:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.182712:0:9124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 37 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.182722:0:9124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.182758:0:9124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 37 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.182787:0:9124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 37 pid: 9124 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856841.182804:0:9124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436372480:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856841.185482:0:9124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890780 going to sleep for 11 seconds 00000100:00100000:2.0:1787856841.190912:0:9124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9124:1874703436372480:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856841.190944:0:9124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856841.193564:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.193672:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426876928 00000100:00100000:2.0:1787856841.193681:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426876928 00000100:00100000:2.0:1787856841.193740:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:2.0:1787856841.193750:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+38:6171:x1874703426876928:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787856841.194368:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+39:6171:x1874703426876928:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 616us (809us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787856841.194378:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:3.0:1787856841.200562:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.200688:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426877056 00000100:00100000:0.0:1787856841.200698:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426877056 00010000:00010000:0.0:1787856841.200741:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 39 pid: 9124 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856841.200784:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:0.0:1787856841.200793:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+39:2402:x1874703426877056:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856841.200808:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856841.200815:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 39 pid: 9124 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.200828:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 39 pid: 9124 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.200851:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c47fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6205 expref: 39 pid: 9124 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.200867:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:0.0:1787856841.200872:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.200882:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.200906:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.200935:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856841.200995:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+38:2402:x1874703426877056:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 203us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856841.201003:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 95 00010000:00010000:1.0:1787856841.201150:0:9124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.201160:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.201196:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.201202:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.201208:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.201248:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856841.201253:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.201260:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.201269:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:1.0:1787856841.201278:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856841.201282:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.201288:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b600/0xc25410d92a3c4865 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.201326:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+37:12405:x1874703426876672:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 18729us (19609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856841.201334:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:1.0:1787856841.204580:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.208134:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426877312 00000100:00100000:2.0:1787856841.208150:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426877312 00000100:00100000:2.0:1787856841.208376:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:2.0:1787856841.208390:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+37:12405:x1874703426877312:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787856841.208626:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+38:12405:x1874703426877312:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 239us (4054us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787856841.210192:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1787856841.357992:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.358281:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426877568 00000100:00100000:0.0:1787856841.358289:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426877568 00000100:00100000:0.0:1787856841.358349:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:0.0:1787856841.358356:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+38:12416:x1874703426877568:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1787856841.358376:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856841.358400:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c486c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6228 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358461:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358471:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358481:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358492:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358499:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358526:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358633:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4881 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358643:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358651:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856841.358671:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787856841.358741:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358746:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358751:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358754:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856841.358757:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358762:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358770:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856841.358772:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856841.358780:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358784:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c4873 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358795:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358799:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358803:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358805:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bac00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856841.358807:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358811:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358817:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c5b79200) 00010000:00010000:0.0:1787856841.358819:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856841.358822:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358826:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c487a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358867:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c486c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6228 expref: 41 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358893:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4881 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6228 expref: 40 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.358900:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:0.0:1787856841.358903:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856841.358906:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbc00, rc 0) 00000100:00100000:0.0:1787856841.358974:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+40:12416:x1874703426877568:12345-192.168.202.6@tcp:101:cat.0 Request processed in 617us (992us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787856841.358981:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:0.0:1787856841.369300:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856841.369679:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426877824 00000100:00100000:3.0:1787856841.369689:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426877824 00000100:00100000:3.0:1787856841.369757:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:3.0:1787856841.369767:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+40:12416:x1874703426877824:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:3.0:1787856841.370198:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+41:12416:x1874703426877824:12345-192.168.202.6@tcp:35:cat.0 Request processed in 430us (905us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787856841.370207:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:3.0:1787856841.391806:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.392156:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426878080 00000100:00100000:1.0:1787856841.392164:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426878080 00000100:00100000:1.0:1787856841.392332:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 214 00000100:00100000:1.0:1787856841.392341:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+41:12417:x1874703426878080:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:1.0:1787856841.392398:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787856841.392422:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c481f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6213 expref: 41 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392438:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c4881 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6228 expref: 40 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392446:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4857 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6221 expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392454:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4811 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a620c expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392460:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:1.0:1787856841.392476:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787856841.392502:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392513:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392519:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392527:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392531:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392535:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392605:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392614:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392620:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856841.392821:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1787856841.392832:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375102613523ns, next at 376102610680ns, rc = 0 00010000:00010000:1.0:1787856841.392878:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392897:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392905:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392913:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392917:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392921:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392934:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856841.392951:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392956:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392962:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392968:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856841.392972:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.392979:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393010:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:1.0:1787856841.393013:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787856841.393018:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393024:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c489d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393040:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393047:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393051:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393054:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856841.393056:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393059:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393064:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:1.0:1787856841.393066:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856841.393067:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393071:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c488f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787856841.393085:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061d545a1 reply state 00000000153e9bab transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393095:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.393101:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c3c5fe00) 00010000:00010000:1.0:1787856841.393103:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787856841.393106:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787856841.393175:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+39:12417:x1874703426878080:12345-192.168.202.6@tcp:36:rm.0 Request processed in 834us (1376us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787856841.393180:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 214 00010000:00010000:3.0:1787856841.394531:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856841.394541:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.394548:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939c00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856841.394552:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.394560:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.394572:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:3.0:1787856841.394575:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787856841.394579:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.394585:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c48a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.394599:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856841.394601:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856841.394613:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856841.449318:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.449436:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426878336 00000100:00100000:1.0:1787856841.449445:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426878336 00000100:00100000:1.0:1787856841.449512:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:1.0:1787856841.449523:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+39:12423:x1874703426878336:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787856841.449546:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856841.449575:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c48ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a622f expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.449683:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.449697:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.449708:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.449729:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.449737:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.449743:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787856841.450517:0:9124:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787856841.452393:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452414:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452426:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452463:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452470:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452477:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452483:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856841.452500:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452509:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452522:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856841.452525:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856841.452530:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452537:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856841.452551:0:9124:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000626bfb96 reply state 00000000312cc72c transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452562:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452568:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c3c5fe00) 00010000:00010000:0.0:1787856841.452570:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856841.452574:0:9124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787856841.452608:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c48ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 42 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452624:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 41 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.452643:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9065c5b79200) 00010000:00010000:0.0:1787856841.452646:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856841.452673:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bac00, rc 0) 00000100:00100000:0.0:1787856841.452756:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+42:12423:x1874703426878336:12345-192.168.202.6@tcp:101:bash.0 Request processed in 3234us (3445us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787856841.452767:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:0.0:1787856841.460142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.460256:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426878464 00000100:00100000:1.0:1787856841.460271:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426878464 00000100:00100000:1.0:1787856841.460371:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:1.0:1787856841.460381:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426878464:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787856841.460400:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856841.460421:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6236 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787856841.460447:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787856841.460467:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1787856841.460472:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856841.460482:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 6 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.460501:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 6 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.460534:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938800, rc 0) 00000100:00100000:1.0:1787856841.460609:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2399:x1874703426878464:12345-192.168.202.6@tcp:101:bash.0 Request processed in 230us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856841.460617:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00080000:0.0:1787856841.460707:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856841.467921:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.471808:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426878592 00000100:00100000:0.0:1787856841.472546:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426878592 00000100:00100000:0.0:1787856841.472798:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1787856841.472822:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7061680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+6:12423:x1874703426878592:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856841.472843:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856841.472861:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a623d expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.472904:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.472916:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856841.472920:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856841.472925:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.472971:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.472985:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 7 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856841.473021:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1874703436372608:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856841.473140:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856841.478879:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.479010:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1874703436372608:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856841.479045:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.479067:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb000, rc 0) 00000100:00100000:0.0:1787856841.479137:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7061680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:12423:x1874703426878592:12345-192.168.202.6@tcp:101:bash.0 Request processed in 6329us (11225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856841.479146:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:1.0:1787856841.479356:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426878720 00000100:00100000:1.0:1787856841.479363:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426878720 00010000:00010000:1.0:1787856841.479398:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 7 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.479435:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:1.0:1787856841.479445:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426878720:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856841.479459:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856841.479479:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 7 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.479491:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 7 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.479515:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c48ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6236 expref: 7 pid: 8409 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.479529:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856841.479533:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856841.479542:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.479568:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.479602:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.479616:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a79e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6482:1874703436372736:192.168.202.6@tcp:105: 00000100:00100000:1.0:1787856841.479683:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787856841.487488:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a79e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6482:1874703436372736:192.168.202.6@tcp:105: 00010000:00010000:1.0:1787856841.487516:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856841.487576:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426878720:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 8131us (8716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856841.487587:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:3.0:1787856841.499567:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.499798:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426878976 00000100:00100000:2.0:1787856841.499823:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426878976 00000100:00100000:2.0:1787856841.499888:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:2.0:1787856841.499899:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+42:12423:x1874703426878976:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1787856841.500522:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+43:12423:x1874703426878976:12345-192.168.202.6@tcp:35:bash.0 Request processed in 622us (963us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787856841.500531:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:0.0:1787856841.554340:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856841.554366:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436372864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856841.554438:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856841.554581:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436372864 00000100:00100000:2.0:1787856841.554590:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436372864 00000100:00100000:2.0:1787856841.554638:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787856841.554648:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436372864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856841.554696:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787856841.554756:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436372864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856841.554762:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787856841.555697:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436372864:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787856841.617846:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856841.669314:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.669767:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426879104 00000100:00100000:1.0:1787856841.669778:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426879104 00000100:00100000:1.0:1787856841.669846:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:1.0:1787856841.669856:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+43:12439:x1874703426879104:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856841.669882:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856841.669902:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c48dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6244 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.669979:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.669994:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.670021:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856841.670081:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787856841.670085:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787856841.670107:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.670133:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c48dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6244 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.670152:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6244 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.670161:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:1.0:1787856841.670164:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856841.670168:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938000, rc 0) 00000100:00100000:1.0:1787856841.670302:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+44:12439:x1874703426879104:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 447us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856841.670310:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:0.0:1787856841.674745:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.675019:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426879360 00000100:00100000:2.0:1787856841.675029:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426879360 00000100:00100000:2.0:1787856841.675092:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:2.0:1787856841.675102:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+44:12439:x1874703426879360:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856841.675121:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856841.675142:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c48ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a624b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.675287:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c48f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.675302:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c48f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.675330:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c48f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856841.675343:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787856841.675447:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c48ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a624b expref: 47 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.675464:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c48f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a624b expref: 46 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.675472:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9065c5b79200) 00010000:00010000:2.0:1787856841.675475:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856841.675478:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b000, rc 0) 00000100:00100000:2.0:1787856841.675538:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+46:12439:x1874703426879360:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 438us (804us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1787856841.675544:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:3.0:1787856841.678531:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.678710:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426879744 00000100:00100000:0.0:1787856841.678720:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426879744 00000100:00100000:0.0:1787856841.678786:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:0.0:1787856841.678797:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+46:12439:x1874703426879744:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856841.680084:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856841.680111:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c48ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6252 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.680239:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4906 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.680266:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4906 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.680280:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4906 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856841.680295:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:3.0:1787856841.681091:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.682442:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426879616 00000100:00100000:1.0:1787856841.682455:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426879616 00000100:00100000:1.0:1787856841.682527:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1787856841.682537:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+48:2401:x1874703426879616:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856841.682553:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856841.682578:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c48f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a624b expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.682611:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9065c5b79200) 00010000:00010000:1.0:1787856841.682616:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856841.682693:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898e91b3-529b-44bc-a821-726bff6c71d4+47:2401:x1874703426879616:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 156us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856841.682701:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00010000:00010000:0.0:1787856841.683461:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c48ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6252 expref: 48 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.683482:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4906 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6252 expref: 47 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.683489:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9065c5b79200) 00010000:00010000:0.0:1787856841.683491:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787856841.683494:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba000, rc 0) 00000100:00100000:0.0:1787856841.683530:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+47:12439:x1874703426879744:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 4735us (5008us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1787856841.683537:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:3.0:1787856841.699030:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.699137:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426879872 00000100:00100000:1.0:1787856841.699147:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426879872 00000100:00100000:1.0:1787856841.699210:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1787856841.699259:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+6:2402:x1874703426879872:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:1.0:1787856841.699303:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.699321:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.699342:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856841.699346:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787856841.699351:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.699383:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.699396:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 6 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.699428:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a79e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8409:1874703436372992:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856841.699520:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856841.703801:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.703972:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a79e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8409:1874703436372992:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856841.704002:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856841.704208:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426880000 00000100:00100000:3.0:1787856841.704309:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426880000 00002000:00100000:3.0:1787856841.704432:0:8414:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9064c83ce580 x1874703426880000/t0(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:242/0 lens 504/0 e 0 to 0 dl 1787856852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856841.704443:0:8414:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c83ce580 with x1874703426880000 ext(0->8) 00010000:00010000:3.0:1787856841.704450:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 7 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.704463:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 7 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856841.704471:0:8414:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9064c83ce580 00000100:00100000:3.0:1787856841.704550:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:3.0:1787856841.704561:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426880000:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:3.0:1787856841.705925:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:898e91b3-529b-44bc-a821-726bff6c71d4+9:2401:x1874703426880000:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 1360us (2127us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787856841.705936:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00002000:00100000:3.0:1787856841.705956:0:8414:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9064c83ce580 x1874703426880000/t4294967309(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:242/0 lens 504/448 e 0 to 0 dl 1787856852 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856841.705965:0:8414:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9064c83ce580 with x1874703426880000 ext(0->8) 00010000:00010000:3.0:1787856841.705974:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 9 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.705989:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 9 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856841.705997:0:8414:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9064c83ce580 00000100:00100000:0.0:1787856841.709335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856841.709471:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426880128 00000100:00100000:3.0:1787856841.709481:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426880128 00010000:00010000:3.0:1787856841.709524:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 9 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856841.709571:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:3.0:1787856841.709583:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+9:2402:x1874703426880128:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856841.709598:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787856841.709616:0:13165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787856841.709619:0:13165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787856841 00002000:00010000:3.0:1787856841.709622:0:13165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787856841 00002000:00010000:3.0:1787856841.709624:0:13165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787856841 00002000:00010000:3.0:1787856841.709626:0:13165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787856841.709643:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 9 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.709685:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 9 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.709709:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c48d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a623d expref: 9 pid: 8407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.709725:0:13165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787856841.709729:0:13165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787856841.709735:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.709745:0:13165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.709791:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856841.709847:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426880128:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 266us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856841.709855:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00010000:00010000:1.0:1787856841.710126:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.710137:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.710158:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.710167:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.710175:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.710182:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856841.710186:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.710207:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.710259:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.710268:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000141db9b4/0xc25410d92a3c4914 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.710321:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426879872:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 11102us (11300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856841.710342:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1787856841.715710:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.715849:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426880384 00000100:00100000:2.0:1787856841.715862:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426880384 00000100:00100000:2.0:1787856841.715938:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:2.0:1787856841.715949:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0391850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+47:12439:x1874703426880384:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:2.0:1787856841.716019:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4906 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6252 expref: 47 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856841.716294:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1787856841.716342:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787856841.716828:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1787856841.716877:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.716894:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 51 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.716904:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.716938:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 51 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.716954:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 51 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856841.716968:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6500:1874703436373120:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856841.717055:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe8909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856841.721737:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.721958:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6500:1874703436373120:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856841.721985:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.722118:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426880512 00000100:00100000:1.0:1787856841.722124:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426880512 00010000:00010000:1.0:1787856841.722158:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 52 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.722251:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:1.0:1787856841.722261:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+52:2402:x1874703426880512:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856841.722276:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856841.722282:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 52 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.722294:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 52 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.722339:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c48c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a622f expref: 52 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.722354:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9065c5b79200) 00010000:00010000:1.0:1787856841.722359:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.722368:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.722375:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.722440:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856841.722485:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+51:2402:x1874703426880512:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 225us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856841.722492:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 98 00010000:00010000:3.0:1787856841.723823:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.723837:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787856841.723967:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1787856841.724084:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1787856841.724173:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1874703436373248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787856841.724285:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856841.724321:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d21900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856841.724591:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436373248 00000100:00100000:0.0:1787856841.724597:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436373248 00000100:00100000:0.0:1787856841.724665:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787856841.724675:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1874703436373248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787856841.724766:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1874703436373248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856841.724783:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787856841.725002:0:6500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1787856841.725008:0:6500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1787856841.725030:0:6500:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9066008e0f00, transno 4294967308 00000100:00100000:3.0:1787856841.725054:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1874703436373248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787856841.725170:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1787856841.725260:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1874703436373376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787856841.725295:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856841.725309:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d21840 going to sleep for 11 seconds 00000100:00100000:0.0:1787856841.725551:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436373376 00000100:00100000:0.0:1787856841.725556:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436373376 00000100:00100000:0.0:1787856841.725591:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787856841.725599:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1874703436373376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787856841.725828:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6500:x1874703436373376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 229us (531us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787856841.725835:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787856841.725978:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1874703436373376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787856841.726023:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1787856841.726058:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.726067:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.726073:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.726078:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856841.726083:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.726090:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.726106:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9065c5b79200) 00010000:00010000:3.0:1787856841.726118:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787856841.726123:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.726129:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c491b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787856841.726259:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787856841.726317:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1787856841.726406:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375436188210ns, next at 376436185230ns, rc = 0 00000001:00080000:3.0:1787856841.726414:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1787856841.726440:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9065c5b79200) 00010000:00010000:3.0:1787856841.726443:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787856841.726451:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4906 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6252 expref: 55 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856841.726541:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0391850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+54:12439:x1874703426880384:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 10595us (10841us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787856841.726550:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000020:00080000:3.0:1787856841.726554:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787856841.730945:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.731038:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426880640 00000100:00100000:2.0:1787856841.731048:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426880640 00000100:00100000:2.0:1787856841.731114:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:2.0:1787856841.731124:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065eb44c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+54:12439:x1874703426880640:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856841.731148:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856841.731170:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4922 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6259 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.731288:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4922 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6259 expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.731304:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4922 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6259 expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.731322:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:2.0:1787856841.731336:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787856841.731340:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ba00, rc 0) 00000100:00100000:2.0:1787856841.731394:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065eb44c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+55:12439:x1874703426880640:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 271us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856841.731401:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:0.0:1787856841.747833:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856841.748015:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426880896 00000100:00100000:3.0:1787856841.748026:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426880896 00000100:00100000:3.0:1787856841.748093:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1787856841.748104:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+55:12439:x1874703426880896:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856841.748393:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+56:12439:x1874703426880896:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 290us (581us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787856841.748400:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:0.0:1787856841.834917:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856841.835147:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426881024 00000100:00100000:2.0:1787856841.835155:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426881024 00000100:00100000:2.0:1787856841.835307:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:2.0:1787856841.835315:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+56:12449:x1874703426881024:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1787856841.835386:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835401:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835410:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835417:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835438:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835442:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835502:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835506:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835510:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856841.835549:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835559:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835563:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835567:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835571:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856841.835574:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835578:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835592:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856841.835594:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856841.835597:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835601:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b400/0xc25410d92a3c4929 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835609:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835613:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835616:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835619:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856841.835621:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835625:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835628:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c3c5fe00) 00010000:00010000:2.0:1787856841.835629:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856841.835632:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835637:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c4930 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835666:0:8909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835671:0:8909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835677:0:8909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835682:0:8909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856841.835685:0:8909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835691:0:8909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835700:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:2.0:1787856841.835702:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856841.835704:0:8909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.835708:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4937 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856841.835815:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+56:12449:x1874703426881024:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 500us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856841.835822:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:1.0:1787856841.869692:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.870422:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426881280 00000100:00100000:0.0:1787856841.870432:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426881280 00000100:00100000:0.0:1787856841.870548:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:0.0:1787856841.870559:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+56:12452:x1874703426881280:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856841.870591:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856841.870612:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c493e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6260 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870730:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870744:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870757:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870788:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870796:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870803:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870911:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870921:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.870928:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856841.870938:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787856841.871020:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871027:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871033:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871039:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856841.871043:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871060:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871073:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856841.871076:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856841.871081:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871087:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c4945 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871103:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871108:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871114:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871119:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856841.871122:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871128:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871135:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c3c5fe00) 00010000:00010000:0.0:1787856841.871138:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856841.871141:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871156:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c494c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871191:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c493e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 59 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871204:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 58 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.871211:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856841.871214:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856841.871266:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb400, rc 0) 00000100:00100000:0.0:1787856841.871345:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+58:12452:x1874703426881280:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 788us (1667us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787856841.871354:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:0.0:1787856841.874106:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856841.874181:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426881408 00000100:00100000:1.0:1787856841.874190:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426881408 00000100:00100000:1.0:1787856841.874266:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 222 00000100:00100000:1.0:1787856841.874277:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+58:12452:x1874703426881408:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1787856841.874361:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874378:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874389:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874440:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874447:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874453:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874459:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939a00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856841.874463:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874470:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874482:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856841.874485:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856841.874488:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856841.874492:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c4961 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.874557:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+58:12452:x1874703426881408:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 282us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856841.874561:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 222 00000100:00100000:1.0:1787856841.876103:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856841.876179:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426881664 00000100:00100000:3.0:1787856841.876187:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426881664 00000100:00100000:3.0:1787856841.876289:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:3.0:1787856841.876297:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+58:12452:x1874703426881664:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787856841.876519:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+59:12452:x1874703426881664:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 221us (422us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787856841.876526:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1787856841.952069:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.952134:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426881920 00000100:00100000:0.0:1787856841.952143:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426881920 00000100:00100000:0.0:1787856841.952198:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:0.0:1787856841.952207:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+59:12462:x1874703426881920:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856841.952314:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856841.952318:0:8909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787856841.952344:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c48e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6244 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.952358:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856841.952374:0:8909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856841.952386:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4968 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6267 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.952476:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.952487:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 59 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.952493:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.952516:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 59 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.952525:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 59 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856841.952535:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436373504:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856841.952710:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856841.955017:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436373504:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856841.955020:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1787856841.955043:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856841.955253:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426882048 00000100:00100000:2.0:1787856841.955260:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426882048 00010000:00010000:2.0:1787856841.955310:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 60 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856841.955344:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:2.0:1787856841.955354:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+60:2402:x1874703426882048:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856841.955367:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856841.955372:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 60 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.955380:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 60 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.955398:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c4953 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6260 expref: 60 pid: 9124 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.955410:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:2.0:1787856841.955414:0:13166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.955420:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.955425:0:13166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856841.955443:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856841.955461:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.955468:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856841.955491:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:2.0:1787856841.955494:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+59:2402:x1874703426882048:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 141us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856841.955501:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 99 00010000:00010000:0.0:1787856841.955614:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4968 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 60 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.955630:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 59 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.955637:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856841.955640:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787856841.955642:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb000, rc 0) 00000100:00100000:0.0:1787856841.955707:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+59:12462:x1874703426881920:12345-192.168.202.6@tcp:101:bash.0 Request processed in 3501us (3647us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787856841.955715:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:1.0:1787856841.957500:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.957637:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426882176 00000100:00100000:0.0:1787856841.957658:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426882176 00000100:00100000:0.0:1787856841.957709:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:0.0:1787856841.957719:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+59:12462:x1874703426882176:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856841.957745:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856841.957773:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c497d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a626e expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.957805:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.957817:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.957838:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.957939:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c497d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 61 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.957951:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 60 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.957957:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856841.957959:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787856841.957962:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba400, rc 0) 00000100:00100000:0.0:1787856841.958006:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+60:12462:x1874703426882176:12345-192.168.202.6@tcp:101:bash.0 Request processed in 289us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856841.958013:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:3.0:1787856841.962530:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.962607:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426882432 00000100:00100000:0.0:1787856841.962618:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426882432 00000100:00100000:0.0:1787856841.962684:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 225 00000100:00100000:0.0:1787856841.962694:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+60:12462:x1874703426882432:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:0.0:1787856841.962948:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.962965:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.962976:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787856841.963043:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1787856841.963061:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c2f0a32 reply state 00000000df983d4d transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.963071:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.963076:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856841.963078:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856841.963080:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856841.963173:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+63:12462:x1874703426882432:12345-192.168.202.6@tcp:36:bash.0 Request processed in 480us (652us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787856841.963180:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 225 00000020:00080000:0.0:1787856841.963185:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787856841.966411:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856841.966473:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426882560 00000100:00100000:0.0:1787856841.966481:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426882560 00000100:00100000:0.0:1787856841.966529:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:0.0:1787856841.966536:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+63:12462:x1874703426882560:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787856841.966555:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856841.966572:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4992 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6275 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.966675:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.966694:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 64 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.966703:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.966752:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 64 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.966765:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 64 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856841.966778:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436373632:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856841.966913:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856841.969267:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436373632:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856841.969295:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856841.970695:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856841.970779:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426882688 00000100:00100000:3.0:1787856841.970788:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426882688 00010000:00010000:3.0:1787856841.970834:0:13165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 65 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856841.970881:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:3.0:1787856841.970892:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+65:2401:x1874703426882688:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856841.970907:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856841.970913:0:13165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 65 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.970925:0:13165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 65 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.970948:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c496f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6267 expref: 65 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.970966:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:3.0:1787856841.970971:0:13165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.970996:0:13165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.971005:0:13165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856841.971035:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856841.971097:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+64:2401:x1874703426882688:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 207us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856841.971105:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 100 00010000:00010000:0.0:1787856841.971801:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.971810:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856841.971856:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787856841.971860:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856841.971886:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.971915:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4992 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 64 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.971926:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 63 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856841.971944:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856841.971946:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856841.971948:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbe00, rc 0) 00000100:00100000:0.0:1787856841.971993:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+63:12462:x1874703426882560:12345-192.168.202.6@tcp:101:bash.0 Request processed in 5456us (5589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856841.972001:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:1.0:1787856841.974776:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856841.974808:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426882944 00000100:00100000:3.0:1787856841.974817:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426882944 00000100:00100000:3.0:1787856841.974941:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:3.0:1787856841.974951:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+63:12462:x1874703426882944:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:3.0:1787856841.975159:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+64:12462:x1874703426882944:12345-192.168.202.6@tcp:35:bash.0 Request processed in 209us (392us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1787856841.975167:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:1.0:1787856842.047353:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.047479:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426883072 00000100:00100000:0.0:1787856842.047490:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426883072 00000100:00100000:0.0:1787856842.047584:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:0.0:1787856842.047596:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+64:12468:x1874703426883072:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856842.047619:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856842.047639:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c49a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a627c expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.047714:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c49a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.047729:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c49a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.047741:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c49a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856842.047787:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787856842.047792:0:9124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856842.047812:0:9124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c49a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.047858:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c49a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a627c expref: 66 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.047877:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c49a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a627c expref: 65 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.047886:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856842.047889:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787856842.047893:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb600, rc 0) 00000100:00100000:0.0:1787856842.048094:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+65:12468:x1874703426883072:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 500us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.048103:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00080000:1.0:1787856842.048264:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856842.058593:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.060272:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426883200 00000100:00100000:0.0:1787856842.060287:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426883200 00000100:00100000:0.0:1787856842.060370:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:0.0:1787856842.060382:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+65:12468:x1874703426883200:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856842.060402:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856842.060423:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c49ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6283 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060488:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060503:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060514:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060543:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060550:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060557:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060641:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060662:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060670:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856842.060711:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787856842.060716:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787856842.060735:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060747:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060756:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060764:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060781:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060788:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856842.060792:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060799:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060812:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856842.060815:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856842.060820:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060826:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c49b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060838:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060843:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060848:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060853:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856842.060855:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060871:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060879:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c3c5fe00) 00010000:00010000:0.0:1787856842.060881:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856842.060885:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060891:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c49bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060919:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c49ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060931:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.060937:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856842.060940:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856842.060942:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bac00, rc 0) 00000100:00100000:0.0:1787856842.061038:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+66:12468:x1874703426883200:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 659us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.061046:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:2.0:1787856842.067564:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.067789:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.067896:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426883584 00000100:00100000:0.0:1787856842.067908:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426883584 00000100:00100000:0.0:1787856842.067989:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:0.0:1787856842.067998:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+66:12468:x1874703426883584:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787856842.068018:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856842.068049:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c49ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a628a expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.068152:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.068164:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 67 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.068170:0:8909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.068176:0:8909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.068201:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.068210:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 67 pid: 6496 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.068235:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436373760:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856842.068327:0:8909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 67 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.068529:0:8909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 67 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.068539:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436373888:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856842.068755:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856842.068959:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426883328 00000100:00100000:1.0:1787856842.068966:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426883328 00010000:00010000:1.0:1787856842.069007:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 68 pid: 6496 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856842.069046:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:1.0:1787856842.069055:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+68:2402:x1874703426883328:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856842.069065:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856842.069072:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 68 pid: 6496 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.069085:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 68 pid: 6496 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.069103:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856842.069107:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.069114:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.069119:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856842.069146:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+68:2402:x1874703426883328:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 92us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856842.069160:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:2.0:1787856842.072732:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856842.073152:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426883712 00000100:00100000:3.0:1787856842.073161:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426883712 00010000:00010000:3.0:1787856842.073207:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 68 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856842.073284:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:3.0:1787856842.073294:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+68:2402:x1874703426883712:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856842.073310:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856842.073317:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 68 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.073348:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 68 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.073373:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:3.0:1787856842.073378:0:13166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.073387:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.073395:0:13166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.073416:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856842.073471:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+68:2402:x1874703426883712:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 177us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856842.073479:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 102 00010000:00010000:0.0:1787856842.073722:0:8909:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.6@tcp) returned -22 from blocking AST (req@00000000b941c60e x1874703436373760) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 67 pid: 6496 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.073737:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c49c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6283 expref: 67 pid: 6496 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.073764:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436373760:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856842.073780:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4999 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6275 expref: 66 pid: 8909 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.073789:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8909:1874703436373888:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856842.073806:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856842.073812:0:8909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.073820:0:8909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.073827:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856842.073846:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787856842.074053:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c49ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 67 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.074068:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 66 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.074086:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856842.074089:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787856842.074091:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb400, rc 0) 00000100:00100000:0.0:1787856842.074361:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+66:12468:x1874703426883584:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 6362us (6571us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787856842.074370:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:2.0:1787856842.081436:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856842.081552:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426883968 00000100:00100000:3.0:1787856842.081561:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426883968 00000100:00100000:3.0:1787856842.081776:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1787856842.081789:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+66:12468:x1874703426883968:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:3.0:1787856842.081806:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856842.081834:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c4922 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6259 expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.081854:0:13165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:3.0:1787856842.081859:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856842.084516:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:898e91b3-529b-44bc-a821-726bff6c71d4+65:12468:x1874703426883968:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 2718us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856842.084530:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1787856842.088314:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.088412:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426884096 00000100:00100000:2.0:1787856842.088422:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426884096 00000100:00100000:2.0:1787856842.088480:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 230 00000100:00100000:2.0:1787856842.088489:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+65:12468:x1874703426884096:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:2.0:1787856842.088833:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.088853:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.088937:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856842.089032:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787856842.089150:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+65:12468:x1874703426884096:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 661us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856842.089159:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 230 00000100:00100000:0.0:1787856842.092131:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.092288:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426884224 00000100:00100000:1.0:1787856842.092298:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426884224 00000100:00100000:1.0:1787856842.092400:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 231 00000100:00100000:1.0:1787856842.092411:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+65:12468:x1874703426884224:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787856842.092432:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856842.092454:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6291 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.092512:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.092524:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.092543:0:6498:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.092556:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.092570:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856842.092584:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856842.092589:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.092597:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938000, rc 0) 00000100:00100000:1.0:1787856842.092731:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+66:12468:x1874703426884224:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 322us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856842.092739:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 231 00000040:00080000:1.0:1787856842.577993:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787856842.641451:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787856842.705476:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856842.705487:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856842.705518:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787856842.705528:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787856842.705701:0:13777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436374016:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787856842.706032:0:13777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c8d21b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856842.724443:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.724786:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426884352 00000100:00100000:2.0:1787856842.724795:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426884352 00000100:00100000:2.0:1787856842.724859:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:2.0:1787856842.724879:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+67:12469:x1874703426884352:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787856842.724913:0:8909:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787856842.725040:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+67:12469:x1874703426884352:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 164us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856842.725048:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:3.0:1787856842.726413:0:13777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436374016:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787856842.730512:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.730604:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426884480 00000100:00100000:2.0:1787856842.730614:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426884480 00000100:00100000:2.0:1787856842.730760:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:2.0:1787856842.730772:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+66:12469:x1874703426884480:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787856842.730848:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.730877:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.730888:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.730904:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.730911:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.730917:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.730939:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.730947:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.730954:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856842.730997:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787856842.731012:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856842.731028:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731039:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731045:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731051:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731057:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.731061:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731068:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731079:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:2.0:1787856842.731082:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856842.731086:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731093:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c49ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731105:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731110:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731127:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731132:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.731135:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731141:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731148:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9064c73f6a00) 00010000:00010000:2.0:1787856842.731150:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856842.731153:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731157:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c49f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731172:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731178:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731182:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731187:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215be00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.731189:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731204:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731211:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:2.0:1787856842.731213:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856842.731260:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.731266:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c49fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856842.731343:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+66:12469:x1874703426884480:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 573us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856842.731351:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:1.0:1787856842.735423:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.738303:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426884736 00000100:00100000:0.0:1787856842.738318:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426884736 00000100:00100000:0.0:1787856842.738393:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 234 00000100:00100000:0.0:1787856842.738404:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+66:12469:x1874703426884736:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856842.738425:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856842.738447:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6298 expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.738729:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.738745:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.739397:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856842.739412:0:9124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787856842.740513:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.740528:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.741357:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.741364:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bac00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856842.741370:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.741379:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.741395:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:0.0:1787856842.741399:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787856842.741404:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.741410:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.741477:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a02 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6298 expref: 68 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.741489:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:0.0:1787856842.741491:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787856842.741495:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6298 expref: 68 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.741526:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbe00, rc 0) 00000100:00100000:0.0:1787856842.741606:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+67:12469:x1874703426884736:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3203us (6193us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1787856842.741615:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 234 00000100:00100000:3.0:1787856842.745178:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.745295:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426884864 00000100:00100000:0.0:1787856842.745305:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426884864 00000100:00100000:0.0:1787856842.745365:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 235 00000100:00100000:0.0:1787856842.745374:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+67:12469:x1874703426884864:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787856842.745407:0:6496:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787856842.745513:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+67:12469:x1874703426884864:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 140us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.745520:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 235 00000100:00100000:1.0:1787856842.751427:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.751710:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426885120 00000100:00100000:2.0:1787856842.751720:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426885120 00000100:00100000:2.0:1787856842.751782:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:2.0:1787856842.751793:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+67:12469:x1874703426885120:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856842.751815:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856842.751818:0:8909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787856842.751866:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb600/0xc25410d92a3c49a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a627c expref: 67 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.751885:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:2.0:1787856842.751891:0:8909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787856842.751904:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a17 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a629f expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787856842.752356:0:8909:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787856842.752498:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4a1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.752511:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.752521:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.752581:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a629f expref: 69 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.752597:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4a1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a629f expref: 68 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.752605:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9064c73f6a00) 00010000:00010000:2.0:1787856842.752607:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787856842.752610:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b800, rc 0) 00000100:00100000:2.0:1787856842.752677:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+68:12469:x1874703426885120:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 885us (1260us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787856842.752686:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:1.0:1787856842.758321:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.758436:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426885376 00000100:00100000:0.0:1787856842.758447:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426885376 00000100:00100000:0.0:1787856842.758517:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 237 00000100:00100000:0.0:1787856842.758527:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+68:12469:x1874703426885376:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787856842.758585:0:9124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856842.758613:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b800/0xc25410d92a3c4a1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a629f expref: 68 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758632:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9064c73f6a00) 00010000:00010000:0.0:1787856842.758652:0:9124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856842.758674:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758707:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758717:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758734:0:9124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758741:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758749:0:9124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758792:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758799:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758805:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758810:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbe00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856842.758814:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758821:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758829:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:0.0:1787856842.758838:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856842.758843:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.758849:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a2c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.762378:0:9124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.762393:0:9124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.762401:0:9124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.762407:0:9124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bac00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787856842.762412:0:9124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.762420:0:9124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.762437:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xab79206a (ffff9065c5b79f00) 00010000:00010000:0.0:1787856842.762440:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856842.762445:0:9124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.762451:0:9124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a33 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xab79206a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.762561:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+67:12469:x1874703426885376:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 4030us (4247us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787856842.762585:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 237 00000100:00100000:3.0:1787856842.767207:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.767323:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426885504 00000100:00100000:0.0:1787856842.767334:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426885504 00000100:00100000:0.0:1787856842.767386:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:0.0:1787856842.767397:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+67:12469:x1874703426885504:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856842.767418:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856842.767441:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62a6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.767476:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.767490:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.767501:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.767616:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 69 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.767633:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.767650:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:0.0:1787856842.767653:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787856842.767656:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba000, rc 0) 00000100:00100000:0.0:1787856842.767726:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+68:12469:x1874703426885504:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 331us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.767740:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:1.0:1787856842.771257:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.771350:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426885760 00000100:00100000:2.0:1787856842.771359:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426885760 00000100:00100000:2.0:1787856842.771445:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:2.0:1787856842.771455:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+68:12469:x1874703426885760:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787856842.771527:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.771554:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.771565:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856842.771736:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787856842.771746:0:8909:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376481528603ns, next at 377481525807ns, rc = 0 00000004:00010000:2.0:1787856842.771794:0:8909:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba1556c5 reply state 00000000a6de338f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.771808:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.771815:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:2.0:1787856842.771818:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787856842.771821:0:8909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856842.771909:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+70:12469:x1874703426885760:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 455us (695us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787856842.771916:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:3.0:1787856842.773948:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.774004:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426885888 00000100:00100000:0.0:1787856842.774012:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426885888 00000100:00100000:0.0:1787856842.774130:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:0.0:1787856842.774141:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+70:12469:x1874703426885888:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856842.774162:0:9124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856842.774181:0:9124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62ad expref: -99 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.774268:0:9124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 71 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.774284:0:9124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 71 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.774316:0:9124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:0.0:1787856842.774320:0:9124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787856842.774323:0:9124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bac00, rc 0) 00000100:00100000:0.0:1787856842.774367:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+71:12469:x1874703426885888:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 229us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.774374:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:3.0:1787856842.778982:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.779165:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426886016 00000100:00100000:2.0:1787856842.779174:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426886016 00000100:00100000:2.0:1787856842.779285:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:2.0:1787856842.779295:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+9:2402:x1874703426886016:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787856842.779508:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+10:2402:x1874703426886016:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 213us (533us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787856842.779516:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00080000:1.0:1787856842.780085:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856842.783007:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.783133:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426886272 00000100:00100000:0.0:1787856842.783143:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426886272 00000100:00100000:0.0:1787856842.783198:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1787856842.783208:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+71:12469:x1874703426886272:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787856842.783508:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+72:12469:x1874703426886272:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 301us (510us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787856842.783527:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1787856842.786028:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.786185:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426886528 00000100:00100000:1.0:1787856842.786196:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426886528 00000100:00100000:1.0:1787856842.786309:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:1.0:1787856842.786320:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+72:12469:x1874703426886528:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787856842.786434:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+72:12469:x1874703426886528:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 115us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856842.786441:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:1.0:1787856842.790282:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.790407:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426886656 00000100:00100000:2.0:1787856842.790417:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426886656 00000100:00100000:2.0:1787856842.790480:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 242 00000100:00100000:2.0:1787856842.790489:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+72:12469:x1874703426886656:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856842.790509:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856842.790530:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c4a56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62b4 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.790610:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4a5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.790636:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4a5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.790657:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4a5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856842.790701:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856842.790721:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4a5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.790749:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b000/0xc25410d92a3c4a56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62b4 expref: 74 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.790782:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4a5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62b4 expref: 73 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.790792:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:2.0:1787856842.790795:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787856842.790799:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b200, rc 0) 00000100:00100000:2.0:1787856842.791205:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+73:12469:x1874703426886656:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 715us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856842.791214:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 242 00000100:00100000:3.0:1787856842.794626:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.794710:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426886784 00000100:00100000:1.0:1787856842.794719:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426886784 00000100:00100000:1.0:1787856842.794789:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:1.0:1787856842.794800:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+10:2402:x1874703426886784:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856842.794818:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856842.794849:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62bb expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787856842.794882:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9087ca, blocks: 0x0 00010000:00010000:1.0:1787856842.794916:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1787856842.794921:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856842.794932:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 11 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.794949:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 11 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.794963:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939c00, rc 0) 00000100:00100000:1.0:1787856842.795911:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+11:2402:x1874703426886784:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1107us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856842.795922:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:2.0:1787856842.799427:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.799516:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426887040 00000100:00100000:1.0:1787856842.799525:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426887040 00000100:00100000:1.0:1787856842.799592:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 243 00000100:00100000:1.0:1787856842.799602:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+73:12469:x1874703426887040:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787856842.800098:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+73:12469:x1874703426887040:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 495us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856842.800107:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 243 00000100:00100000:2.0:1787856842.816483:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.816600:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426887168 00000100:00100000:0.0:1787856842.816612:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426887168 00000100:00100000:0.0:1787856842.816691:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1787856842.816703:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+11:12469:x1874703426887168:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856842.816722:0:10490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856842.816744:0:10490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62c2 expref: -99 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.816776:0:10490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 12 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.816784:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856842.816788:0:10490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856842.816793:0:10490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 12 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.816827:0:10490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 12 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.816855:0:10490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 12 pid: 8410 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.816878:0:10490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436374144:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856842.816967:0:10490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856842.822602:0:10490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10490:1874703436374144:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856842.822664:0:10490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 12 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.822688:0:10490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007baa00, rc 0) 00000100:00100000:0.0:1787856842.822761:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+12:12469:x1874703426887168:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 6059us (6286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.822771:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:1.0:1787856842.830746:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.830881:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426887296 00000100:00100000:2.0:1787856842.830893:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426887296 00010000:00010000:2.0:1787856842.830943:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 12 pid: 8410 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856842.830988:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:2.0:1787856842.830998:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+12:2402:x1874703426887296:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856842.831014:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856842.831037:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 12 pid: 8410 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.831050:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 12 pid: 8410 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.831074:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051ee7dac/0xc25410d92a3c4a64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62bb expref: 12 pid: 8410 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.831093:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856842.831097:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856842.831105:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 11 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.831137:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 11 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.831177:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 11 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856842.831193:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cfc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1874703436374272:192.168.202.6@tcp:105: 00000100:00100000:2.0:1787856842.831322:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890540 going to sleep for 11 seconds 00000100:00100000:1.0:1787856842.836200:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cfc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1874703436374272:192.168.202.6@tcp:105: 00010000:00010000:1.0:1787856842.836269:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856842.836334:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898e91b3-529b-44bc-a821-726bff6c71d4+11:2402:x1874703426887296:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 5336us (5596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856842.836346:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:1.0:1787856842.839765:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856842.848657:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426887424 00000100:00100000:3.0:1787856842.848673:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426887424 00002000:00100000:2.0:1787856842.849028:0:8413:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff906601a7bc00 x1874703426887424/t0(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:243/0 lens 504/0 e 0 to 0 dl 1787856853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787856842.849042:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff906601a7bc00 with x1874703426887424 ext(0->12) 00002000:00010000:2.0:1787856842.849047:0:8413:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff906601a7bc00 00000100:00100000:2.0:1787856842.849087:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:2.0:1787856842.849096:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+11:2401:x1874703426887424:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787856842.852427:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:898e91b3-529b-44bc-a821-726bff6c71d4+13:2401:x1874703426887424:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 3320us (12661us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787856842.852442:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00002000:00100000:2.0:1787856842.852456:0:8413:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff906601a7bc00 x1874703426887424/t4294967321(0) o4->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:243/0 lens 504/448 e 0 to 0 dl 1787856853 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787856842.852467:0:8413:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff906601a7bc00 with x1874703426887424 ext(0->12) 00002000:00010000:2.0:1787856842.852473:0:8413:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff906601a7bc00 00000100:00100000:2.0:1787856842.856164:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.856365:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426887552 00000100:00100000:1.0:1787856842.856376:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426887552 00000100:00100000:1.0:1787856842.856436:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 244 00000100:00100000:1.0:1787856842.856446:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+73:12469:x1874703426887552:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787856842.861118:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1787856842.861136:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787856842.861179:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:2.0:1787856842.861189:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861202:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787856842.861208:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9065c8d21900 refcount 2 committed 0 result 0 batchid 7 00010000:00010000:2.0:1787856842.861209:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787856842.861212:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9064c6b4e100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9065c8d21180 00000020:00080000:0.0:1787856842.861234:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9064c6b4ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9064c887f600 00010000:00010000:2.0:1787856842.861236:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.861241:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861250:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787856842.861261:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00010000:00010000:2.0:1787856842.861267:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9065c3c5f500) 00010000:00010000:2.0:1787856842.861270:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856842.861274:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861280:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba800/0xc25410d92a3c4770 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787856842.861282:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9065c85f5a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787856842.861285:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065c3cf8e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9065c85f5840 00000020:00080000:0.0:1787856842.861288:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065c3cf8400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9065d8e82400 00000020:00080000:0.0:1787856842.861309:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:2.0:1787856842.861325:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861332:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861338:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861352:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.861355:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861360:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861368:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9064c73f6900) 00010000:00010000:2.0:1787856842.861370:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856842.861373:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861379:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c4818 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787856842.861382:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1787856842.861396:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861402:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861407:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861411:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938a00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.861413:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861419:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861435:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c3c5fe00) 00010000:00010000:2.0:1787856842.861438:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856842.861440:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861445:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938a00/0xc25410d92a3c4896 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861457:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861462:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861467:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861472:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.861474:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861480:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861486:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9065c3c5fe00) 00010000:00010000:2.0:1787856842.861489:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856842.861491:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861496:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c48b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.861498:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:12469:x1874703426887552:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 5050us (5345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.861508:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 244 00010000:00010000:2.0:1787856842.861516:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861522:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861527:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861531:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.861534:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861540:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861548:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:2.0:1787856842.861550:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856842.861553:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861558:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c498b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861569:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861575:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861580:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861591:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787856842.861594:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861600:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861608:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:2.0:1787856842.861611:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787856842.861614:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.861620:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4a48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856842.861801:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436374656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787856842.861873:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856842.861922:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436374656 00000100:00100000:3.0:1787856842.861929:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436374656 00000100:00100000:3.0:1787856842.861993:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787856842.862003:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436374656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787856842.862003:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436374528:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787856842.862031:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856842.862053:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856842.862058:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436374400:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787856842.862078:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1787856842.862107:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787856842.862111:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787856842 00002000:00010000:3.0:1787856842.862113:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1787856842.862117:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436374528 00000100:00100000:2.0:1787856842.862121:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436374528 00002000:00010000:3.0:1787856842.862122:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787856842 -> 1787856842 00002000:00010000:3.0:1787856842.862124:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787856842.862137:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436374400 00000100:00100000:2.0:1787856842.862140:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436374400 00000100:00100000:2.0:1787856842.862155:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787856842.862156:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3623:x1874703436374656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (282us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787856842.862161:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3626:x1874703436374528:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787856842.862162:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787856842.862175:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00002000:00080000:2.0:1787856842.862175:0:8407:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00000100:00100000:3.0:1787856842.862181:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436374400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787856842.862190:0:8409:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787856842.862191:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856842.862207:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9087c9, atime: 0x6a9087c9, ctime: 0x6a9087c9, blocks: 0x8 00010000:00010000:3.0:1787856842.862212:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.862214:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 12 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.862244:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1787856842.862249:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856842.862254:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787856842.862255:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.862257:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787856842.862262:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.862268:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.862276:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.862283:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.862285:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 12 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.862298:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787856842.862298:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 12 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856842.862310:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436374784:192.168.202.6@tcp:104: 00000100:00080000:1.0:1787856842.862424:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856842.862429:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856842.867303:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3626:x1874703436374400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5110us (5211us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787856842.867308:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856842.867317:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787856842.867352:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426887680 00000100:00100000:3.0:1787856842.867360:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426887680 00000100:00100000:3.0:1787856842.867402:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:3.0:1787856842.867410:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+13:2402:x1874703426887680:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787856842.867486:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856842.867495:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.867509:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9e00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856842.867514:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.867526:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.867547:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.867556:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f320ba2/0xc25410d92a3c4a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.867579:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856842.867581:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856842.867583:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856842.867726:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890840 going to sleep for 11 seconds 00000004:00080000:3.0:1787856842.867780:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9064c826ed00/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787856842.867787:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436374656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1787856842.870621:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9064c6b5c780/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787856842.870635:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436374400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787856842.875059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.875266:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426887808 00000100:00100000:0.0:1787856842.875291:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426887808 00010000:00010000:0.0:1787856842.875331:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 14 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.875367:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:0.0:1787856842.875377:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+14:2402:x1874703426887808:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856842.875392:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856842.875397:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 14 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.875410:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 14 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.875437:0:13166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856842.875442:0:13166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856842.875448:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.875457:0:13166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.875475:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856842.875531:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+14:2402:x1874703426887808:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 155us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.875539:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 104 00010000:00010000:3.0:1787856842.875801:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058588dca/0xc25410d92a3c4826 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a621a expref: 13 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856842.875817:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436374784:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787856842.875839:0:8407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.875849:0:8407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.875856:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.875866:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.875873:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.875890:0:8407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787856842.876035:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3626:x1874703436374528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13873us (14002us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787856842.876044:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1787856842.876064:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856842.876076:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.876084:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856842.876088:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.876098:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.876111:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.876118:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd2de81/0xc25410d92a3c4a72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.876134:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856842.876135:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856842.876137:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787856842.876768:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9064c826c3c0/2, rc 0, transno 4294967323 00000100:00100000:1.0:1787856842.876778:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436374528:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787856842.878161:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787856842.878174:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1787856842.878429:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426887680:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 11015us (11118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856842.878441:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:1.0:1787856842.897387:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.897504:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426888064 00000100:00100000:0.0:1787856842.897517:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426888064 00000100:00100000:0.0:1787856842.897578:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 245 00000100:00100000:0.0:1787856842.897588:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+21:12469:x1874703426888064:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787856842.897663:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856842.897693:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c4a5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62b4 expref: 21 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.897723:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:0.0:1787856842.897728:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856842.897761:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.897776:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.897786:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787856842.897914:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017618264 reply state 000000005abbafcf transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.897927:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.897933:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:0.0:1787856842.897935:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787856842.897938:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856842.898039:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:12469:x1874703426888064:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 452us (662us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1787856842.898063:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 245 00000100:00100000:2.0:1787856842.905529:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.905682:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426888192 00000100:00100000:0.0:1787856842.905692:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426888192 00000100:00100000:0.0:1787856842.905752:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:0.0:1787856842.905762:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2401:x1874703426888192:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787856842.905926:0:10490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787856842.905930:0:10490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787856842 -> 1787856841 00002000:00010000:0.0:1787856842.905932:0:10490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787856841 00002000:00010000:0.0:1787856842.905934:0:10490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787856842 -> 1787856841 00002000:00010000:0.0:1787856842.905936:0:10490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787856842.906010:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+8:2401:x1874703426888192:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 249us (489us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787856842.906018:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:2.0:1787856842.909343:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.909810:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426888448 00000100:00100000:1.0:1787856842.909821:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426888448 00000100:00100000:1.0:1787856842.909884:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 246 00000100:00100000:1.0:1787856842.909895:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+22:12469:x1874703426888448:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787856842.909965:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.909983:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.909993:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.910028:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.910061:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 22 pid: 6496 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856842.910076:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436374912:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787856842.910166:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f73783c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856842.912966:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436374912:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856842.912997:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856842.914433:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.914600:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426888576 00000100:00100000:0.0:1787856842.914609:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426888576 00010000:00010000:0.0:1787856842.914658:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 23 pid: 6496 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.914705:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:0.0:1787856842.914716:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+23:2401:x1874703426888576:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856842.914731:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856842.914738:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 23 pid: 6496 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.914750:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 23 pid: 6496 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.914789:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c4a41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62a6 expref: 23 pid: 6496 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.914804:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:0.0:1787856842.914809:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.914817:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.914824:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.914854:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856842.914914:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+22:2401:x1874703426888576:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 200us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856842.914922:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 105 00010000:00010000:1.0:1787856842.915057:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.915066:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.915106:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.915113:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.915120:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.915126:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856842.915130:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.915150:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.915161:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:1.0:1787856842.915163:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787856842.915167:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.915173:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4a87 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856842.915270:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+21:12469:x1874703426888448:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 5323us (5893us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787856842.915281:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 246 00000100:00100000:2.0:1787856842.923977:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856842.926794:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426888704 00000100:00100000:3.0:1787856842.926810:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426888704 00000100:00100000:2.0:1787856842.929568:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:2.0:1787856842.929583:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426888704:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787856842.929631:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.929682:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.929692:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856842.929706:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787856842.929712:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.929752:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 8 pid: 10490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.929768:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 8 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856842.929785:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436375040:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856842.929887:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856842.949088:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.950715:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426888832 00000100:00100000:1.0:1787856842.950729:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426888832 00010000:00010000:1.0:1787856842.950779:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 9 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856842.950831:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:1.0:1787856842.950851:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+9:2401:x1874703426888832:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856842.950869:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856842.950892:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 9 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.950907:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 9 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.950954:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787856842.950959:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787856842.950966:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.950976:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.950997:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856842.951063:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+9:2401:x1874703426888832:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 222us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856842.951071:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 106 00010000:00010000:0.0:1787856842.953273:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4a6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c2 expref: 8 pid: 10490 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.953299:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1874703436375040:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787856842.953336:0:8407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953547:0:8407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953559:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953589:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953599:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953607:0:8407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953630:0:8407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856842.953635:0:8407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953654:0:8407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953671:0:8407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.953678:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4248b6e/0xc25410d92a3c4a8e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856842.953931:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426888704:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 24349us (29963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856842.953942:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:2.0:1787856842.965530:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856842.965659:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426889088 00000100:00100000:0.0:1787856842.965669:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426889088 00000100:00100000:0.0:1787856842.965743:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 247 00000100:00100000:0.0:1787856842.965765:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+21:12469:x1874703426889088:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787856842.965854:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.965878:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 21 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.965887:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.965921:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 21 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.965933:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 21 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.965947:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436375168:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856842.966031:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856842.974998:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.975253:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436375168:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856842.975281:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856842.975362:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426889216 00000100:00100000:3.0:1787856842.975369:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426889216 00010000:00010000:3.0:1787856842.975409:0:13166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 22 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856842.975470:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:3.0:1787856842.975480:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+22:2401:x1874703426889216:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856842.975497:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856842.975504:0:13166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 22 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.975517:0:13166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 22 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.975541:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba400/0xc25410d92a3c4984 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a626e expref: 22 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.975556:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:3.0:1787856842.975563:0:13166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.975573:0:13166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.975580:0:13166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.975587:0:13166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.975606:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856842.975682:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+21:2401:x1874703426889216:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 202us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856842.975705:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 107 00010000:00010000:0.0:1787856842.977573:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.977588:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.977791:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.977808:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 21 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.977832:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.978078:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 21 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.978095:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 21 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856842.978109:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436375296:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787856842.978196:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787856842.983373:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856842.983517:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426889344 00000100:00100000:2.0:1787856842.983525:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426889344 00010000:00010000:2.0:1787856842.983563:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 22 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856842.983603:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:2.0:1787856842.983613:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+22:2401:x1874703426889344:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856842.983658:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856842.983666:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 22 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.983680:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 22 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.983703:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:2.0:1787856842.983708:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.983717:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.983725:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856842.983742:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856842.983805:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898e91b3-529b-44bc-a821-726bff6c71d4+22:2401:x1874703426889344:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 193us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856842.983812:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 108 00010000:00010000:1.0:1787856842.985441:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bac00/0xc25410d92a3c4a4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62ad expref: 21 pid: 9124 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856842.985464:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436375296:192.168.202.6@tcp:104: 00010000:00010000:1.0:1787856842.985505:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.985516:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.985522:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856842.985703:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1787856842.985823:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1787856842.985946:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1787856842.986029:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1874703436375424:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787856842.986089:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856842.986127:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c2b866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856842.986356:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436375424 00000100:00100000:2.0:1787856842.986364:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436375424 00000100:00100000:2.0:1787856842.986410:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787856842.986420:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6497:x1874703436375424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787856842.986503:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6497:x1874703436375424:12345-0@lo:1000:mdt00_001.0 Request processed in 84us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856842.986511:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787856842.986662:0:6497:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1787856842.986667:0:6497:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1787856842.986684:0:6497:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9064c826ed00, transno 4294967322 00000100:00100000:1.0:1787856842.986706:0:6497:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9064c826c3c0 x1874703436374528/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787856858 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856842.986718:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1874703436375424:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787856842.986832:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1787856842.986889:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1874703436375552:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787856842.986918:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856842.986938:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856842.987159:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436375552 00000100:00100000:2.0:1787856842.987164:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436375552 00000100:00100000:2.0:1787856842.987196:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787856842.987203:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6497:x1874703436375552:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787856842.987327:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6497:x1874703436375552:12345-0@lo:1000:mdt00_001.0 Request processed in 124us (407us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787856842.987334:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787856842.987630:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1874703436375552:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787856842.987674:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987700:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987708:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987715:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbe00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856842.987720:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987729:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987744:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:1.0:1787856842.987747:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856842.987752:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987758:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbe00/0xc25410d92a3c4a9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987784:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987790:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987796:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987800:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856842.987810:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987816:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987824:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856842.987826:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856842.987833:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987845:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987865:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.987894:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856842.987906:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436375680:192.168.202.6@tcp:105: 00000100:00100000:1.0:1787856842.987975:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7b5a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856842.991286:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856842.991422:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1874703436375680:192.168.202.6@tcp:105: 00010000:00010000:1.0:1787856842.991454:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991465:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a600/0xc25410d92a3c49df lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991515:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991530:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991540:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991549:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991555:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991561:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991566:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856842.991570:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991577:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991587:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856842.991590:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856842.991594:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991600:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938200/0xc25410d92a3c4aa3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991620:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991625:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991630:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991634:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007baa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856842.991646:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991651:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991659:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856842.991661:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787856842.991663:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856842.991668:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c4a95 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856842.991832:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:12469:x1874703426889088:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 26066us (26309us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787856842.991842:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 247 00000020:00080000:1.0:1787856842.991850:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787856842.992259:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787856842.992264:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787856842.992795:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787856842.992804:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787856842.994210:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426889472 00000100:00100000:3.0:1787856842.994292:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426889472 00000100:00100000:2.0:1787856842.994535:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1787856842.994546:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:12468:x1874703426889472:12345-192.168.202.6@tcp:49:lfs.0 00000100:00100000:2.0:1787856842.995011:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+24:12468:x1874703426889472:12345-192.168.202.6@tcp:49:lfs.0 Request processed in 464us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856842.995020:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1787856842.996769:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856842.996940:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426889728 00000100:00100000:3.0:1787856842.996948:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426889728 00000100:00100000:3.0:1787856842.997041:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1787856842.997052:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0390450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+24:12469:x1874703426889728:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787856842.997535:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787856842.997571:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1787856842.997608:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.997635:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.997656:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.997664:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.997671:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.997677:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856842.997699:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787856842.997818:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0390450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+26:12469:x1874703426889728:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 768us (1053us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787856842.997843:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000020:00080000:3.0:1787856842.997848:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787856842.998723:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856842.998733:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.998742:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9e00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856842.998746:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.998754:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.998769:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:0.0:1787856842.998771:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787856842.998776:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.998797:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9e00/0xc25410d92a3c4aaa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856842.998811:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856842.998813:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856842.998815:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856843.000473:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856843.000568:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426889984 00000100:00100000:0.0:1787856843.000577:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426889984 00000100:00100000:0.0:1787856843.000738:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 248 00000100:00100000:0.0:1787856843.000748:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+26:12468:x1874703426889984:12345-192.168.202.6@tcp:58:lfs.0 00000040:00080000:0.0:1787856843.001311:0:9124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787856843.001509:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+26:12468:x1874703426889984:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 760us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856843.001518:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 248 00000100:00100000:1.0:1787856843.047131:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856843.047259:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426890112 00000100:00100000:2.0:1787856843.047270:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426890112 00000100:00100000:2.0:1787856843.047342:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 249 00000100:00100000:2.0:1787856843.047353:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+26:12471:x1874703426890112:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856843.047377:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856843.047399:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4ab1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62c9 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047466:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047488:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047499:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047515:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047522:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047529:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047603:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047614:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 27 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047635:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047675:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 27 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856843.047687:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 27 pid: 8909 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856843.047714:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d8780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436375808:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787856843.047821:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe890780 going to sleep for 11 seconds 00000100:00100000:3.0:1787856843.052679:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856843.053036:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426890368 00000100:00100000:0.0:1787856843.053046:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426890368 00000100:00100000:0.0:1787856843.053103:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1787856843.053113:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+28:6171:x1874703426890368:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787856843.053598:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+29:6171:x1874703426890368:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 485us (927us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787856843.053606:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1787856843.053842:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d8780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1874703436375808:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787856843.053877:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856843.058476:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856843.058573:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426890496 00000100:00100000:1.0:1787856843.058585:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426890496 00010000:00010000:1.0:1787856843.058706:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 29 pid: 8909 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856843.058804:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:1.0:1787856843.058815:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+29:2401:x1874703426890496:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856843.058830:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856843.058838:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 29 pid: 8909 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856843.058852:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 29 pid: 8909 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856843.058888:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c49d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a628a expref: 29 pid: 8909 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856843.058904:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856843.058910:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856843.058918:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856843.058926:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856843.058962:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856843.059020:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898e91b3-529b-44bc-a821-726bff6c71d4+28:2401:x1874703426890496:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 207us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856843.059042:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 109 00010000:00010000:3.0:1787856843.059694:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059706:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856843.059770:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787856843.059775:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787856843.059794:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059808:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059818:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059825:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059833:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059840:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856843.059844:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059853:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059882:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:3.0:1787856843.059885:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856843.059890:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059897:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a400/0xc25410d92a3c4ab8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059909:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059916:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059922:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059928:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856843.059931:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059937:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059944:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9064c73f6f00) 00010000:00010000:3.0:1787856843.059946:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856843.059949:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.059956:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c4abf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.060005:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215aa00/0xc25410d92a3c4ab1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c9 expref: 28 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.060019:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c9 expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856843.060027:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:3.0:1787856843.060029:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787856843.060032:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215bc00, rc 0) 00000100:00100000:3.0:1787856843.060087:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+27:12471:x1874703426890112:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 12736us (12967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856843.060096:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 249 00000100:00100000:1.0:1787856843.228266:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856843.228306:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856843.228455:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856843.228481:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426891136 00000100:00100000:1.0:1787856843.228491:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426891136 00000100:00100000:1.0:1787856843.228548:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 352 00000100:00100000:1.0:1787856843.228558:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426891136:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856843.228800:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426890624 00000100:00100000:2.0:1787856843.228805:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426890624 00000100:00100000:2.0:1787856843.228838:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 394 00000100:00100000:2.0:1787856843.228847:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426890624:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856843.228952:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426890880 00000100:00100000:3.0:1787856843.228957:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426890880 00000100:00100000:1.0:1787856843.229007:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426891136:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 450us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856843.229016:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 352 00000100:00100000:3.0:1787856843.229573:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:3.0:1787856843.229596:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2399:x1874703426890880:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856843.229681:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426890624:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 835us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856843.229689:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 394 00000100:00080000:1.0:1787856843.230167:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856843.230171:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856843.230306:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856843.230532:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856843.230579:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2399:x1874703426890880:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 997us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856843.230587:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:2.0:1787856843.236252:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426890752 00000100:00100000:2.0:1787856843.236268:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426890752 00000100:00080000:1.0:1787856843.236438:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856843.236595:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426891008 00000100:00100000:2.0:1787856843.236599:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426891008 00000100:00080000:1.0:1787856843.236728:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856843.236750:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 353 00000100:00100000:1.0:1787856843.236763:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426890752:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856843.236865:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2399:x1874703426890752:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 94us (6547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856843.236873:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 353 00000100:00100000:1.0:1787856843.236894:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 354 00000100:00100000:1.0:1787856843.236901:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426891008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856843.236928:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2399:x1874703426891008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (6397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856843.236942:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 354 00010000:00010000:3.0:1787856843.665391:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787856843.861804:0:14739:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787856843.861813:0:14739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787856843.862100:0:14739:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787856843.862107:0:14739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787856844.051051:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787856844.051059:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787856844.051084:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787856844.051092:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787856844.051382:0:13777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826d2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436375936:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787856844.051488:0:13777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6bc4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856844.057127:0:13777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826d2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1874703436375936:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787856844.059999:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856844.061121:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426891264 00000100:00100000:2.0:1787856844.061135:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426891264 00000100:00080000:3.0:1787856844.061279:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856844.061349:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 250 00000100:00100000:2.0:1787856844.061361:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+27:12483:x1874703426891264:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787856844.061410:0:8909:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787856844.061541:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+27:12483:x1874703426891264:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 182us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856844.061550:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 250 00000100:00100000:1.0:1787856844.064582:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856844.064732:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426891520 00000100:00100000:3.0:1787856844.064743:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426891520 00000100:00100000:3.0:1787856844.064802:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 251 00000100:00100000:3.0:1787856844.064812:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+27:12483:x1874703426891520:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787856844.064850:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856844.064869:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4acd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62d0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.064987:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4ad4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.065002:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.065013:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856844.065024:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787856844.065137:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8c00/0xc25410d92a3c4acd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62d0 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.065154:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62d0 expref: 29 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.065162:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:3.0:1787856844.065165:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787856844.065169:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8e00, rc 0) 00000100:00100000:3.0:1787856844.065531:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:898e91b3-529b-44bc-a821-726bff6c71d4+29:12483:x1874703426891520:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 718us (956us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787856844.065538:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 251 00000100:00100000:2.0:1787856844.069814:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856844.069974:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426891648 00000100:00100000:3.0:1787856844.069985:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426891648 00000100:00100000:3.0:1787856844.070088:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:3.0:1787856844.070112:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+29:2401:x1874703426891648:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856844.070129:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856844.070154:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4ad4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62d0 expref: 29 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.070173:0:13166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:3.0:1787856844.070178:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856844.070403:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:898e91b3-529b-44bc-a821-726bff6c71d4+28:2401:x1874703426891648:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 293us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856844.070411:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1787856844.074913:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856844.075014:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426891904 00000100:00100000:3.0:1787856844.075025:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426891904 00000100:00100000:3.0:1787856844.075143:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 252 00000100:00100000:3.0:1787856844.075154:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+28:12483:x1874703426891904:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787856844.075276:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075294:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075304:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075456:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075464:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075488:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075494:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856844.075498:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075506:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075519:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:3.0:1787856844.075522:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787856844.075527:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856844.075534:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4ae2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856844.075681:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+29:12483:x1874703426891904:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 528us (835us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787856844.075690:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 252 00000040:00080000:2.0:1787856844.076175:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787856844.076181:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787856844.076775:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787856844.076784:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787856844.082138:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856844.082807:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426892160 00000100:00100000:0.0:1787856844.082819:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426892160 00000100:00100000:0.0:1787856844.082890:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:0.0:1787856844.082899:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+29:12483:x1874703426892160:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787856844.083150:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+30:12483:x1874703426892160:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 251us (1022us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787856844.083158:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00010000:00010000:3.0:1787856844.689744:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856845.137529:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436376064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856845.137798:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436376192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856845.138040:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.138144:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436376064 00000100:00100000:3.0:1787856845.138152:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436376064 00000100:00100000:3.0:1787856845.138207:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787856845.138235:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1874703436376064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787856845.138262:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787856845.138304:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1874703436376064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856845.138324:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787856845.138348:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.138367:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856845.138373:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436376320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856845.138393:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.138416:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436376192 00000100:00100000:3.0:1787856845.138419:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436376192 00000100:00100000:3.0:1787856845.138437:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436376320 00000100:00100000:3.0:1787856845.138440:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436376320 00000100:00100000:3.0:1787856845.138451:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787856845.138456:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436376192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787856845.138469:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856845.138498:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436376192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856845.138504:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787856845.138514:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787856845.138520:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436376320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856845.138528:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787856845.138545:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436376320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 26us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856845.138550:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787856845.138581:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436376320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856845.138592:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436376192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856845.138725:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436376064:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787856845.138923:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856845.138927:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856845.139736:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436376832:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.139784:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856845.139816:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436377344:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.139979:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856845.140009:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787856845.140015:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436376704:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.140042:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856845.140061:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436377216:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.140083:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856845.140109:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436376832 00000100:00100000:0.0:1787856845.140114:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436376832 00000100:00100000:0.0:1787856845.140148:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436377344 00000100:00100000:0.0:1787856845.140151:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436377344 00000100:00100000:0.0:1787856845.140172:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436377216 00000100:00100000:0.0:1787856845.140175:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436377216 00000100:00100000:0.0:1787856845.140190:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787856845.140197:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d275b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436376832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.140267:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d275b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436376832:12345-0@lo:400:kworker.0 Request processed in 69us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856845.140274:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787856845.140289:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787856845.140303:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436377344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.140334:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436377344:12345-0@lo:400:kworker.0 Request processed in 32us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856845.140341:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787856845.140353:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787856845.140359:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436377216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.140384:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436377216:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856845.140390:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787856845.140408:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436376704 00000100:00100000:0.0:1787856845.140412:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436376704 00000100:00100000:0.0:1787856845.140433:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787856845.140440:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436376704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.140471:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436376704:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856845.140477:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787856845.140511:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436376704:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.140522:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436377216:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.140547:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436376832:0@lo:400:kworker.0 00010000:00080000:0.0:1787856845.140560:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2c3c0 x1874703436377344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856845.140572:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436377344:0@lo:400:kworker.0 00000100:00080000:1.0:1787856845.140723:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856845.140728:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856845.141772:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436376448:0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.141918:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.141964:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436376960:0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.141992:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.142015:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436377472:0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.142039:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.142066:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787856845.142073:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436376576:0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.142094:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.142111:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436377088:0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.142133:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.142151:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436377600:0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.142170:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.142198:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436377088 00000100:00100000:3.0:1787856845.142203:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436377088 00000100:00100000:3.0:1787856845.142266:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787856845.142274:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436377088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.142318:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1874703436377088:12345-0@lo:400:kworker.0 Request processed in 44us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856845.142324:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787856845.142345:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436377472 00000100:00100000:3.0:1787856845.142349:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436377472 00000100:00100000:3.0:1787856845.142374:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436376576 00000100:00100000:3.0:1787856845.142377:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436376576 00000100:00100000:3.0:1787856845.142391:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436377600 00000100:00100000:3.0:1787856845.142393:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436377600 00000100:00100000:3.0:1787856845.142409:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787856845.142415:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436377472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.142451:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1874703436377472:12345-0@lo:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856845.142457:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787856845.142469:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787856845.142474:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436376576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.142494:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436376576:12345-0@lo:400:kworker.0 Request processed in 21us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856845.142499:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787856845.142509:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787856845.142515:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436377600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.142739:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436376960 00000100:00100000:0.0:1787856845.142744:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436376960 00000100:00100000:0.0:1787856845.142775:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787856845.142781:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436376960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.142814:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436376960:12345-0@lo:400:kworker.0 Request processed in 35us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856845.142820:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787856845.143729:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436376448 00000100:00100000:1.0:1787856845.143737:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436376448 00000100:00100000:1.0:1787856845.143776:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1787856845.143784:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436376448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856845.143828:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436376448:12345-0@lo:400:kworker.0 Request processed in 45us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856845.143847:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:1.0:1787856845.143883:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856845.143888:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856845.143891:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856845.144094:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436376576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.144108:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436377088:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.144117:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436376448:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.144127:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436376960:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.144137:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1874703436377472:0@lo:400:kworker.0 00000100:00100000:3.0:1787856845.144320:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436377600:12345-0@lo:400:kworker.0 Request processed in 1804us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856845.144328:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00080000:0.0:1787856845.147242:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2fc00 x1874703436377600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856845.147260:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436377600:0@lo:400:kworker.0 00000100:00100000:0.0:1787856845.649755:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436377728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856845.649824:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856845.653133:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436377728 00000100:00100000:3.0:1787856845.653146:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436377728 00000100:00100000:3.0:1787856845.653204:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787856845.653213:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874703436377728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856845.653255:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856845.653463:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1874703436377728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 249us (3637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856845.653472:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787856845.653554:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436377728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856845.713789:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787856845.809072:0:14791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787856845.809081:0:14791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787856845.809110:0:14791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787856845.809116:0:14791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787856846.007115:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856846.011732:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426892416 00000100:00100000:2.0:1787856846.011746:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426892416 00000100:00100000:2.0:1787856846.011833:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 253 00000100:00100000:2.0:1787856846.011843:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+30:12503:x1874703426892416:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787856846.011866:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856846.011886:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4ae9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62d7 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856846.012000:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c4af0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856846.012014:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c4af0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856846.012025:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c4af0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856846.012036:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787856846.012144:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215be00/0xc25410d92a3c4ae9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62d7 expref: 33 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856846.012181:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c4af0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62d7 expref: 32 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856846.012190:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:2.0:1787856846.012193:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787856846.012197:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ae00, rc 0) 00000100:00080000:0.0:1787856846.012576:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856846.013065:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+32:12503:x1874703426892416:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1222us (5960us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787856846.013076:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 253 00000100:00100000:0.0:1787856846.029641:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856846.029748:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426892544 00000100:00100000:1.0:1787856846.029759:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426892544 00000100:00100000:1.0:1787856846.029815:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 254 00000100:00100000:1.0:1787856846.029824:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+32:12503:x1874703426892544:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1787856846.029890:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.029924:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.029937:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.029976:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.029983:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.029991:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.029997:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787856846.030001:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.030008:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.030020:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856846.030028:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856846.030034:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.030040:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938800/0xc25410d92a3c4afe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856846.030104:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+32:12503:x1874703426892544:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 280us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856846.030112:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 254 00000100:00100000:0.0:1787856846.129837:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856846.129952:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426892672 00000100:00100000:1.0:1787856846.129967:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426892672 00000100:00080000:0.0:1787856846.130038:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787856846.130053:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:1.0:1787856846.130065:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426892672:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1787856846.130085:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856846.130108:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141db9b4/0xc25410d92a3c4b05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62de expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787856846.130135:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9087c9, atime: 0x6a9087c9, ctime: 0x6a9087c9, blocks: 0x8 00010000:00010000:1.0:1787856846.130158:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1787856846.130163:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856846.130173:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141db9b4/0xc25410d92a3c4b05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62de expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.130191:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000141db9b4/0xc25410d92a3c4b05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62de expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856846.130205:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938800, rc 0) 00000100:00100000:1.0:1787856846.130314:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+8:2402:x1874703426892672:12345-192.168.202.6@tcp:101:cat.0 Request processed in 251us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856846.130324:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:1.0:1787856846.134645:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856846.135081:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426892800 00000100:00100000:3.0:1787856846.135091:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426892800 00002000:00100000:3.0:1787856846.135139:0:8414:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff90660198ad00 x1874703426892800/t0(0) o3->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:247/0 lens 488/0 e 0 to 0 dl 1787856857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856846.135148:0:8414:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff90660198ad00 with x1874703426892800 ext(0->4095) 00002000:00010000:3.0:1787856846.135165:0:8414:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90660198ad00 00000100:00100000:3.0:1787856846.135196:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1787856846.135202:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2401:x1874703426892800:12345-192.168.202.6@tcp:3:cat.0 00000100:00100000:3.0:1787856846.135492:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:898e91b3-529b-44bc-a821-726bff6c71d4+8:2401:x1874703426892800:12345-192.168.202.6@tcp:3:cat.0 Request processed in 289us (857us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787856846.135498:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00002000:00100000:3.0:1787856846.135503:0:8414:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff90660198ad00 x1874703426892800/t0(0) o3->898e91b3-529b-44bc-a821-726bff6c71d4@192.168.202.6@tcp:247/0 lens 488/4536 e 0 to 0 dl 1787856857 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787856846.135509:0:8414:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff90660198ad00 with x1874703426892800 ext(0->4095) 00002000:00010000:3.0:1787856846.135512:0:8414:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90660198ad00 00000100:00100000:1.0:1787856846.162459:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856846.162484:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601988f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436377856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787856846.162556:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856846.162828:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436377856 00000100:00100000:0.0:1787856846.162837:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436377856 00000100:00100000:0.0:1787856846.162905:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787856846.162915:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601989680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436377856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856846.162948:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856846.163008:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601989680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436377856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856846.163015:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787856846.163275:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601988f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436377856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856846.673725:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436377984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856846.673804:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856846.674122:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436377984 00000100:00100000:3.0:1787856846.674130:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436377984 00000100:00100000:3.0:1787856846.674239:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787856846.674249:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436377984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856846.674281:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787856846.674340:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436377984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856846.674347:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787856846.674419:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436377984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787856846.737402:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787856847.188238:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1787856847.188258:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:3.0:1787856847.763682:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787856848.215922:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1787856848.215937:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1787856848.216668:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1787856848.216696:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9065f7378d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787856848.216701:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065fe8e8e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9065c6547000 00000020:00080000:2.0:1787856848.216704:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9065fe8e8100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9064c883cc00 00000020:00080000:2.0:1787856848.216730:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1787856848.217997:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856848.218014:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856848.218023:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856848.218047:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787856848.218053:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856848.218060:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856848.218078:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9065c5b79000) 00010000:00010000:3.0:1787856848.218081:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856848.218086:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856848.218092:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb800/0xc25410d92a3c4a80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787856848.219732:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787856848.219829:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1787856848.351776:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856848.351824:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856848.351850:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856848.351868:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426893184 00000100:00100000:3.0:1787856848.351879:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426893184 00000100:00100000:0.0:1787856848.351887:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856848.351908:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856848.351926:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856848.351937:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426893696 00000100:00100000:3.0:1787856848.351940:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426893696 00000100:00100000:0.0:1787856848.351948:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856848.351955:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426893056 00000100:00100000:3.0:1787856848.351957:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426893056 00000100:00100000:0.0:1787856848.351967:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426893440 00000100:00100000:3.0:1787856848.351969:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426893568 00000100:00100000:3.0:1787856848.351971:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426893568 00000100:00100000:0.0:1787856848.351982:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426893440 00000100:00100000:3.0:1787856848.351988:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 361 00000100:00100000:3.0:1787856848.351996:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426893184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856848.352008:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426893312 00000100:00100000:0.0:1787856848.352010:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426893312 00000100:00100000:0.0:1787856848.352032:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:0.0:1787856848.352052:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426893440:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856848.352069:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426893184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 74us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856848.352077:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 361 00000100:00100000:0.0:1787856848.352079:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2402:x1874703426893440:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856848.352084:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:3.0:1787856848.352093:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 362 00000100:00100000:0.0:1787856848.352094:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:0.0:1787856848.352100:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426893312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856848.352105:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426893696:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856848.352120:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2402:x1874703426893312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 21us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856848.352124:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426893696:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 20us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856848.352127:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:3.0:1787856848.352130:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 362 00000100:00100000:3.0:1787856848.352141:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 363 00000100:00100000:3.0:1787856848.352146:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+18:2402:x1874703426893056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856848.352173:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+18:2402:x1874703426893056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856848.352179:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 363 00000100:00100000:3.0:1787856848.352191:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 364 00000100:00100000:3.0:1787856848.352197:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426893568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856848.352261:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426893568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 64us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856848.352268:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 364 00000100:00080000:3.0:1787856848.352290:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856848.352295:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856848.352297:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856848.352299:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856848.352764:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426892928 00000100:00100000:2.0:1787856848.352769:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426892928 00000100:00100000:2.0:1787856848.352813:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 396 00000100:00100000:2.0:1787856848.352821:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2402:x1874703426892928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856848.352859:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2402:x1874703426892928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856848.352865:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 396 00010000:00010000:1.0:1787856848.792913:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856849.809382:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856850.257757:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436378112:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.257829:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.257881:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436378624:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.257909:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.257926:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436379136:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.257968:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.257986:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436379648:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258005:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258031:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787856850.258037:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436378496:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258061:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258077:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436379008:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258096:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258111:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8360f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436379520:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258144:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258171:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436378240:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258194:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258211:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436378752:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258253:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258268:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8362940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436379264:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258286:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258306:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787856850.258311:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436378368:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258331:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258345:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436378880:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258364:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258379:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8360780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436379392:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258399:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.258426:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436378112 00000100:00100000:3.0:1787856850.258441:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436378112 00000100:00100000:3.0:1787856850.258487:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1787856850.258495:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436378112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258541:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436378112:12345-0@lo:400:kworker.0 Request processed in 46us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.258548:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1787856850.258594:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436379136 00000100:00100000:3.0:1787856850.258598:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436379136 00000100:00100000:3.0:1787856850.258626:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436379648 00000100:00100000:3.0:1787856850.258629:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436379648 00000100:00100000:3.0:1787856850.258641:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436379520 00000100:00100000:3.0:1787856850.258643:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436379520 00000100:00100000:3.0:1787856850.258655:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436378752 00000100:00100000:3.0:1787856850.258657:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436378752 00000100:00100000:3.0:1787856850.258669:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787856850.258675:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436379136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258705:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436379136:12345-0@lo:400:kworker.0 Request processed in 31us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.258711:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787856850.258723:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787856850.258729:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436379648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258754:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436379648:12345-0@lo:400:kworker.0 Request processed in 26us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.258760:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787856850.258770:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787856850.258775:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436379520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258801:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436379520:12345-0@lo:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.258814:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787856850.258826:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787856850.258834:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436378752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.258868:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436378752:12345-0@lo:400:kworker.0 Request processed in 36us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.258873:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787856850.258897:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436378496 00000100:00100000:3.0:1787856850.258900:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436378496 00000100:00100000:3.0:1787856850.258918:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436379008 00000100:00100000:3.0:1787856850.258920:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436379008 00000100:00100000:3.0:1787856850.258932:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436378240 00000100:00100000:3.0:1787856850.258934:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436378240 00000100:00100000:3.0:1787856850.258943:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436379264 00000100:00100000:3.0:1787856850.258944:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436379264 00000100:00100000:3.0:1787856850.258953:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436378880 00000100:00100000:3.0:1787856850.258955:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436378880 00000100:00100000:3.0:1787856850.258966:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436379392 00000100:00100000:3.0:1787856850.258968:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436379392 00000100:00100000:3.0:1787856850.258979:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1787856850.258985:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436378496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259012:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436378496:12345-0@lo:400:kworker.0 Request processed in 27us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.259017:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1787856850.259029:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1787856850.259035:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436379008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259058:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436379008:12345-0@lo:400:kworker.0 Request processed in 25us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.259064:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1787856850.259084:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787856850.259089:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436378240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259116:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436378240:12345-0@lo:400:kworker.0 Request processed in 27us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.259122:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787856850.259133:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787856850.259138:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436379264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259162:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436379264:12345-0@lo:400:kworker.0 Request processed in 24us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.259168:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787856850.259178:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1787856850.259183:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436378880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259206:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436378880:12345-0@lo:400:kworker.0 Request processed in 24us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.259212:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1787856850.259250:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787856850.259255:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436379392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259282:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436379392:12345-0@lo:400:kworker.0 Request processed in 27us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.259289:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787856850.259320:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436378624 00000100:00100000:3.0:1787856850.259324:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436378624 00000100:00100000:3.0:1787856850.259340:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436378368 00000100:00100000:3.0:1787856850.259343:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436378368 00000100:00100000:3.0:1787856850.259354:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787856850.259359:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436378624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259401:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436378624:12345-0@lo:400:kworker.0 Request processed in 41us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.259407:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787856850.259418:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787856850.259423:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436378368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259447:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436378368:12345-0@lo:400:kworker.0 Request processed in 25us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.259452:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:3.0:1787856850.259475:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856850.259479:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856850.259482:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856850.259485:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856850.259509:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436378368:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259521:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436378880:0@lo:400:kworker.0 00010000:00080000:3.0:1787856850.259532:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8360780 x1874703436379392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856850.259543:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8360780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436379392:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259553:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436378240:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259561:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1787856850.259567:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1787856850.259596:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9064c6b5c780, transno 4294967311 00000100:00100000:3.0:1787856850.259607:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436378752:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259618:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8362940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436379264:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259753:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436378496:0@lo:400:kworker.0 00010000:00080000:3.0:1787856850.259773:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83cc000 x1874703436379008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856850.259783:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436379008:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259793:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8360f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436379520:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259801:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436378112:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259810:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436378624:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259819:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436379136:0@lo:400:kworker.0 00000100:00100000:3.0:1787856850.259828:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787856850.259831:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9064c826c3c0, transno 4294967323 00000004:00080000:3.0:1787856850.259840:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1787856850.259859:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436379648:0@lo:400:kworker.0 00000100:00100000:2.0:1787856850.260395:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436379776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856850.260436:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856850.260483:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436379776 00000100:00100000:2.0:1787856850.260494:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436379776 00000100:00100000:2.0:1787856850.260529:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787856850.260536:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436379776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856850.260555:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787856850.260600:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436379776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856850.260607:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787856850.260647:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436379776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856850.260689:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436379904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856850.260718:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.260929:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601988f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436380032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856850.260959:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856850.266906:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436379904 00000100:00100000:0.0:1787856850.266921:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436379904 00000100:00100000:0.0:1787856850.267155:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436380032 00000100:00100000:0.0:1787856850.267160:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436380032 00000100:00100000:3.0:1787856850.267420:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787856850.267433:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436379904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787856850.267515:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856850.267783:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436379904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 352us (7062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.267792:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787856850.267813:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787856850.267820:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436380032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787856850.267834:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787856850.267886:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436380032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.267892:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787856850.267937:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601988f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436380032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856850.268408:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436379904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856850.771747:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436380160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856850.771819:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856850.772023:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436380160 00000100:00100000:3.0:1787856850.772031:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436380160 00000100:00100000:3.0:1787856850.772083:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787856850.772093:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436380160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856850.772114:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856850.772171:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436380160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856850.772179:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787856850.772316:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436380160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856850.845104:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856851.291410:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856851.304123:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436380288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856851.304203:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856851.304376:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436380288 00000100:00100000:3.0:1787856851.304385:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436380288 00000100:00100000:3.0:1787856851.304445:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787856851.304453:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436380288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856851.304490:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787856851.304539:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436380288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856851.304547:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787856851.304682:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436380288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856851.798001:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601989e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436380416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856851.798079:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856851.798684:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436380416 00000100:00100000:1.0:1787856851.798696:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436380416 00000100:00100000:1.0:1787856851.798756:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787856851.798765:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436380416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856851.798801:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787856851.798856:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436380416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856851.798863:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787856851.798970:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601989e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436380416:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787856851.861028:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856851.926782:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856851.926855:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426893824 00000100:00100000:3.0:1787856851.926865:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426893824 00000100:00100000:3.0:1787856851.926992:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 255 00000100:00100000:3.0:1787856851.927004:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+18:12148:x1874703426893824:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787856851.927128:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:898e91b3-529b-44bc-a821-726bff6c71d4+18:12148:x1874703426893824:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 Request processed in 128us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856851.927155:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 255 00000100:00080000:0.0:1787856851.927379:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856851.940488:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856851.940683:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426893952 00000100:00100000:3.0:1787856851.940694:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426893952 00000100:00100000:3.0:1787856851.940770:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 256 00000100:00100000:3.0:1787856851.940781:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:12148:x1874703426893952:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787856851.940954:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:12148:x1874703426893952:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 Request processed in 175us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856851.940962:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 256 00000100:00080000:0.0:1787856851.941124:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787856851.946863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856851.946979:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426894208 00000100:00100000:1.0:1787856851.946990:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426894208 00000100:00100000:1.0:1787856851.947051:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1787856851.947062:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+18:12148:x1874703426894208:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787856851.947337:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+19:12148:x1874703426894208:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 276us (483us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787856851.947363:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000040:00080000:3.0:1787856852.307101:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787856852.307110:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856852.307190:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787856852.307196:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787856852.369801:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856852.369893:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426894336 00000100:00100000:3.0:1787856852.369903:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426894336 00000100:00100000:3.0:1787856852.369990:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 257 00000100:00100000:3.0:1787856852.370001:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:12961:x1874703426894336:12345-192.168.202.6@tcp:101:lsof.0 00010000:00010000:3.0:1787856852.370022:0:8909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856852.370041:0:8909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62e5 expref: -99 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856852.370102:0:8909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4b13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856852.370116:0:8909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856852.370131:0:8909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856852.370196:0:8909:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787856852.370200:0:8909:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787856852.370266:0:8909:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856852.370293:0:8909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c9000/0xc25410d92a3c4b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62e5 expref: 7 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856852.370312:0:8909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4b13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62e5 expref: 6 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856852.370321:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:3.0:1787856852.370324:0:8909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787856852.370328:0:8909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8e00, rc 0) 00000100:00100000:3.0:1787856852.370387:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:12961:x1874703426894336:12345-192.168.202.6@tcp:101:lsof.0 Request processed in 387us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856852.370394:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 257 00000100:00080000:0.0:1787856852.371010:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787856852.818367:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787856852.881514:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856853.467502:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856853.467565:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856853.467596:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856853.467620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856853.467646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856853.467664:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856853.467687:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856853.467727:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426894720 00000100:00100000:2.0:1787856853.467737:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426894720 00000100:00100000:2.0:1787856853.467794:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426895232 00000100:00100000:2.0:1787856853.467798:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426895232 00000100:00100000:2.0:1787856853.467812:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426894592 00000100:00100000:2.0:1787856853.467815:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426894592 00000100:00100000:2.0:1787856853.467828:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426895104 00000100:00100000:2.0:1787856853.467846:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426895104 00000100:00100000:2.0:1787856853.467867:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 371 00000100:00100000:2.0:1787856853.467875:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426894720:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856853.467943:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426894720:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 68us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856853.467951:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 371 00000100:00100000:2.0:1787856853.467968:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 372 00000100:00100000:2.0:1787856853.467975:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426895232:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856853.467997:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426895232:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856853.468002:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 372 00000100:00100000:2.0:1787856853.468014:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 373 00000100:00100000:2.0:1787856853.468020:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+19:2400:x1874703426894592:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856853.468064:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+19:2400:x1874703426894592:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 44us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856853.468071:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 373 00000100:00100000:2.0:1787856853.468083:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 374 00000100:00100000:2.0:1787856853.468089:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2400:x1874703426895104:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856853.468114:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2400:x1874703426895104:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856853.468120:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 374 00000100:00080000:2.0:1787856853.468137:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856853.468141:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856853.468694:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426894464 00000100:00100000:1.0:1787856853.468699:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426894464 00000100:00100000:1.0:1787856853.468733:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 398 00000100:00100000:1.0:1787856853.468740:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426894464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787856853.468772:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426894464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 33us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856853.468779:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 398 00000100:00100000:3.0:1787856853.469318:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426894976 00000100:00100000:3.0:1787856853.469323:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426894976 00000100:00100000:3.0:1787856853.469408:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426894848 00000100:00100000:3.0:1787856853.469412:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426894848 00000100:00100000:3.0:1787856853.469443:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:3.0:1787856853.469451:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426894976:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856853.469493:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426894976:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 43us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856853.469501:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:3.0:1787856853.469530:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:3.0:1787856853.469537:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426894848:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856853.469573:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426894848:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 37us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856853.469580:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00080000:2.0:1787856853.470135:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787856853.470139:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787856853.906366:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787856854.358116:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787856854.358132:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787856854.358210:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787856854.358249:0:6528:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787856854.929557:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856855.377539:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436380544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856855.377619:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856855.378034:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436380672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856855.378069:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856855.378290:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436380544 00000100:00100000:2.0:1787856855.378298:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436380544 00000100:00100000:2.0:1787856855.378368:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436380672 00000100:00100000:2.0:1787856855.378371:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436380672 00000100:00100000:2.0:1787856855.378389:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787856855.378399:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436380544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856855.378428:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787856855.378485:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436380544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856855.378492:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787856855.378510:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787856855.378516:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436380672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856855.378540:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856855.378570:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436380672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856855.378575:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787856855.378694:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856855.378699:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787856855.378733:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436380672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856855.379196:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436380544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856855.379476:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436380800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856855.379518:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856855.379652:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436380800 00000100:00100000:1.0:1787856855.379658:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436380800 00000100:00100000:1.0:1787856855.379711:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787856855.379719:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436380800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856855.379732:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787856855.379768:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436380800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856855.379774:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787856855.379802:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436380800:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787856855.379929:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856855.380301:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436381184:0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.380336:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856855.380359:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436381696:0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.380384:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856855.380403:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787856855.380408:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436381056:0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.380428:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856855.380443:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436381568:0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.380496:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856855.380513:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436382080:0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.380544:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856855.380570:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436381184 00000100:00100000:2.0:1787856855.380575:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436381184 00000100:00100000:2.0:1787856855.380604:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787856855.380610:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436381184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.380652:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436381184:12345-0@lo:400:kworker.0 Request processed in 41us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856855.380659:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787856855.380887:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436381696 00000100:00100000:0.0:1787856855.380891:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436381696 00000100:00100000:0.0:1787856855.380920:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436381056 00000100:00100000:0.0:1787856855.380923:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436381056 00000100:00100000:0.0:1787856855.380935:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436382080 00000100:00100000:0.0:1787856855.380938:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436382080 00000100:00100000:0.0:1787856855.380950:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787856855.380955:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436381696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856855.381020:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787856855.381029:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436381056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.381083:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436381184:0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.381121:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787856855.381129:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436382080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856855.381202:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436381568 00000100:00100000:3.0:1787856855.381207:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436381568 00000100:00100000:3.0:1787856855.381260:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787856855.381267:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436381568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.389812:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436381696:12345-0@lo:400:kworker.0 Request processed in 8846us (9416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856855.389829:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:0.0:1787856855.389875:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856855.389881:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856855.389884:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856855.389903:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436380928:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.389947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856855.389984:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436381440:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390013:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856855.390053:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436381952:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390077:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856855.390099:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787856855.390106:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436381312:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390131:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856855.390142:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436381824:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390161:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856855.390196:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436380928 00000100:00100000:0.0:1787856855.390203:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436380928 00000100:00100000:0.0:1787856855.390270:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787856855.390279:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436380928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390329:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436380928:12345-0@lo:400:kworker.0 Request processed in 52us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856855.390335:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787856855.390364:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436381440 00000100:00100000:0.0:1787856855.390368:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436381440 00000100:00100000:0.0:1787856855.390389:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787856855.390396:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436381440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390432:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436381440:12345-0@lo:400:kworker.0 Request processed in 36us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856855.390437:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787856855.390504:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436380928:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390518:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436381440:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390551:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436381952 00000100:00100000:0.0:1787856855.390554:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436381952 00000100:00100000:0.0:1787856855.390581:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436381312 00000100:00100000:0.0:1787856855.390592:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436381312 00000100:00100000:0.0:1787856855.390609:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436381824 00000100:00100000:0.0:1787856855.390611:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436381824 00000100:00100000:0.0:1787856855.390626:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787856855.390631:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436381952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390667:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436381952:12345-0@lo:400:kworker.0 Request processed in 35us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856855.390673:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787856855.390685:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787856855.390690:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436381312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390717:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436381312:12345-0@lo:400:kworker.0 Request processed in 28us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856855.390722:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787856855.390732:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787856855.390737:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436381824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390762:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436381824:12345-0@lo:400:kworker.0 Request processed in 25us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856855.390767:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:0.0:1787856855.390783:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856855.390785:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856855.390801:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436381312:0@lo:400:kworker.0 00010000:00080000:0.0:1787856855.390813:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008dc3c0 x1874703436381824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856855.390823:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436381824:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390833:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436381952:0@lo:400:kworker.0 00000100:00100000:0.0:1787856855.390913:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436381696:0@lo:400:kworker.0 00000100:00100000:1.0:1787856855.391905:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436381056:12345-0@lo:400:kworker.0 Request processed in 10872us (11471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856855.391915:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787856855.392362:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436381056:0@lo:400:kworker.0 00000100:00100000:2.0:1787856855.392499:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436382080:12345-0@lo:400:kworker.0 Request processed in 11369us (11952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856855.392509:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00080000:0.0:1787856855.392617:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9066008dd2c0 x1874703436382080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856855.392628:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436382080:0@lo:400:kworker.0 00000100:00100000:3.0:1787856855.394844:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436381568:12345-0@lo:400:kworker.0 Request processed in 13569us (14339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856855.394860:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787856855.394994:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436381568:0@lo:400:kworker.0 00000100:00100000:3.0:1787856855.889560:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856855.889583:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436382208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856855.889651:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856855.889715:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436382208 00000100:00100000:3.0:1787856855.889722:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436382208 00000100:00100000:3.0:1787856855.889774:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787856855.889784:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436382208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856855.889805:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856855.889847:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436382208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856855.889855:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787856855.889913:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436382208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787856855.955987:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787856856.335119:0:14988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:54:14 (1787856854) 00000100:00100000:0.0:1787856856.405321:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436382336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856856.405395:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856856.405452:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436382336 00000100:00100000:1.0:1787856856.405460:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436382336 00000100:00100000:1.0:1787856856.405539:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787856856.405550:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436382336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856856.405587:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787856856.405637:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436382336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856856.405644:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787856856.405681:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436382336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856856.914662:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436382464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856856.914938:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856856.915082:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436382464 00000100:00100000:2.0:1787856856.915090:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436382464 00000100:00100000:2.0:1787856856.915141:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787856856.915150:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436382464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856856.915183:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787856856.915262:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436382464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856856.915269:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787856856.915456:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436382464:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787856856.981256:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856858.003612:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856858.588205:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856858.588262:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856858.588285:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856858.588309:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856858.588329:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856858.588346:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856858.588371:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856858.588400:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426895488 00000100:00100000:0.0:1787856858.588409:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426895488 00000100:00100000:0.0:1787856858.588468:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426896000 00000100:00100000:0.0:1787856858.588471:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426896000 00000100:00100000:0.0:1787856858.588509:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426895616 00000100:00100000:0.0:1787856858.588512:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426895616 00000100:00100000:0.0:1787856858.588523:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426896128 00000100:00100000:0.0:1787856858.588534:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426896128 00000100:00100000:0.0:1787856858.588557:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 381 00000100:00100000:0.0:1787856858.588565:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+18:2400:x1874703426895488:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856858.588641:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+18:2400:x1874703426895488:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 76us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856858.588649:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 381 00000100:00100000:0.0:1787856858.588667:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 382 00000100:00100000:0.0:1787856858.588674:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2400:x1874703426896000:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856858.588700:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2400:x1874703426896000:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856858.588706:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 382 00000100:00100000:0.0:1787856858.588718:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 383 00000100:00100000:0.0:1787856858.588724:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426895616:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856858.589178:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426895616:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 453us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856858.589185:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 383 00000100:00100000:0.0:1787856858.589200:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 384 00000100:00100000:0.0:1787856858.589207:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426896128:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856858.589264:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2400:x1874703426896128:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 58us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856858.589271:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 384 00000100:00100000:0.0:1787856858.589291:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426895744 00000100:00100000:0.0:1787856858.589295:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426895744 00000100:00100000:0.0:1787856858.589327:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426895872 00000100:00100000:0.0:1787856858.589330:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426895872 00000100:00100000:0.0:1787856858.589363:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:0.0:1787856858.589370:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426895744:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856858.589398:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+5:2400:x1874703426895744:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856858.589405:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:0.0:1787856858.589417:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:0.0:1787856858.589424:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426895872:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856858.589448:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:898e91b3-529b-44bc-a821-726bff6c71d4+7:2400:x1874703426895872:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856858.589455:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:0.0:1787856858.589630:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426895360 00000100:00100000:0.0:1787856858.589634:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426895360 00000100:00100000:0.0:1787856858.589663:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 400 00000100:00100000:0.0:1787856858.589670:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426895360:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787856858.589697:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2400:x1874703426895360:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856858.589703:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 400 00000100:00080000:0.0:1787856858.590030:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856858.590035:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856858.590037:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856858.590040:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787856859.032664:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856860.049496:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856860.497597:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436382848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856860.497670:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856860.497799:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436383104:0@lo:400:kworker.0 00000100:00100000:1.0:1787856860.497834:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856860.508172:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436383488:0@lo:400:kworker.0 00000100:00100000:0.0:1787856860.508172:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436382976:0@lo:400:kworker.0 00000100:00100000:1.0:1787856860.508342:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436383104 00000100:00100000:1.0:1787856860.508351:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436383104 00000100:00100000:1.0:1787856860.508412:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1787856860.508422:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436383104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856860.512888:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436382592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856860.513369:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856860.513437:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436384000:0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.513468:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856860.513514:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787856860.513520:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436383616:0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.513558:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856860.513580:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436384128:0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.513601:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856860.513638:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436382848 00000100:00100000:2.0:1787856860.513645:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436382848 00000100:00100000:2.0:1787856860.513701:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787856860.513710:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436382848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856860.513738:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856860.513782:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436382848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (16111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856860.513789:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787856860.513812:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436383488 00000100:00100000:2.0:1787856860.513815:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436383488 00000100:00100000:2.0:1787856860.513839:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787856860.513846:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436383488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.513879:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436383488:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856860.513905:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787856860.513936:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436383616 00000100:00100000:2.0:1787856860.513940:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436383616 00000100:00100000:2.0:1787856860.513965:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787856860.516451:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.516552:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436383616:12345-0@lo:400:kworker.0 Request processed in 120us (2993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856860.516561:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787856860.516608:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436384000 00000100:00100000:2.0:1787856860.516615:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436384000 00000100:00100000:2.0:1787856860.516663:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436384128 00000100:00100000:2.0:1787856860.516667:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436384128 00000100:00100000:2.0:1787856860.516683:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787856860.516690:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436384000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.516725:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436384000:12345-0@lo:400:kworker.0 Request processed in 35us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856860.516732:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787856860.516744:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787856860.516751:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436384128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.516782:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874703436384128:12345-0@lo:400:kworker.0 Request processed in 31us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856860.516787:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00080000:2.0:1787856860.516804:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856860.516808:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856860.516811:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856860.516867:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436383616:0@lo:400:kworker.0 00010000:00080000:2.0:1787856860.516903:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81bf0c0 x1874703436384128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856860.517251:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436384128:0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.517269:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436384000:0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.517281:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436383488:0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.517301:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436382848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856860.521797:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856860.521951:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436382976 00000100:00100000:2.0:1787856860.521960:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436382976 00000100:00100000:2.0:1787856860.522024:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1787856860.522034:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436382976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.522099:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fbffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436382976:12345-0@lo:400:kworker.0 Request processed in 66us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856860.522107:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1787856860.522512:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436383360:0@lo:400:kworker.0 00000100:00100000:0.0:1787856860.522572:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856860.522604:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436383872:0@lo:400:kworker.0 00000100:00100000:0.0:1787856860.522631:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856860.522658:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436383360 00000100:00100000:0.0:1787856860.522661:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436383360 00000100:00100000:1.0:1787856860.522698:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436383104:12345-0@lo:400:kworker.0 Request processed in 14275us (24861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856860.522702:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436383872 00000100:00100000:1.0:1787856860.522706:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1787856860.522725:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787856860.522733:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436383360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856860.522766:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436383360:12345-0@lo:400:kworker.0 Request processed in 35us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856860.522782:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787856860.522833:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436383104:0@lo:400:kworker.0 00000100:00100000:1.0:1787856860.522879:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436384384:0@lo:400:kworker.0 00000100:00100000:0.0:1787856860.523110:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436383872 00000100:00100000:0.0:1787856860.523158:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787856860.523174:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436383872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856860.523209:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436383872:12345-0@lo:400:kworker.0 Request processed in 36us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856860.523234:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00080000:2.0:1787856860.523360:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856860.527068:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856860.527280:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436384384 00000100:00100000:2.0:1787856860.527291:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436384384 00000100:00100000:2.0:1787856860.527370:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787856860.527381:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436384384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.527457:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436384384:12345-0@lo:400:kworker.0 Request processed in 79us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856860.527465:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787856860.527523:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436384384:0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.527538:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436382976:0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.527576:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436383360:0@lo:400:kworker.0 00010000:00080000:2.0:1787856860.527616:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c81bde00 x1874703436383872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856860.527627:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436383872:0@lo:400:kworker.0 00000100:00080000:0.0:1787856860.528075:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856860.528584:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856860.528635:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436382720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856860.528669:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436382592 00000100:00100000:3.0:1787856860.528672:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856860.528676:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436382592 00000100:00100000:3.0:1787856860.528698:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436383232:0@lo:400:kworker.0 00000100:00100000:3.0:1787856860.528724:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856860.528755:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436383744:0@lo:400:kworker.0 00000100:00100000:3.0:1787856860.528780:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856860.528801:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436384256:0@lo:400:kworker.0 00000100:00100000:3.0:1787856860.528823:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856860.528847:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436384256 00000100:00100000:3.0:1787856860.528850:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436384256 00000100:00100000:2.0:1787856860.528868:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436382720 00000100:00100000:2.0:1787856860.528872:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436382720 00000100:00100000:3.0:1787856860.528890:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787856860.528895:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787856860.528898:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436384256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856860.528900:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436382720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856860.528923:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787856860.528962:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436382720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856860.528969:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1787856860.529000:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856860.529034:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436382720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856860.529116:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787856860.529125:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436382592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856860.529135:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787856860.529310:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436382592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856860.529318:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787856860.529337:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436383744 00000100:00100000:1.0:1787856860.529340:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436383744 00000100:00100000:1.0:1787856860.529421:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787856860.529427:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436383744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856860.529438:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436384256:12345-0@lo:400:kworker.0 Request processed in 540us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856860.529444:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787856860.529454:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436383744:12345-0@lo:400:kworker.0 Request processed in 28us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856860.529459:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787856860.529501:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436382592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856860.529513:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436383744:0@lo:400:kworker.0 00000100:00100000:3.0:1787856860.529520:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436384256:0@lo:400:kworker.0 00000100:00100000:0.0:1787856860.529616:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436383232 00000100:00100000:0.0:1787856860.529621:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436383232 00000100:00100000:0.0:1787856860.529658:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787856860.529666:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436383232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856860.529714:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436383232:12345-0@lo:400:kworker.0 Request processed in 49us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856860.529720:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787856860.529905:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436383232:0@lo:400:kworker.0 00000100:00080000:2.0:1787856860.532601:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856861.011247:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856861.011270:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436384512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856861.011337:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856861.013735:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436384512 00000100:00100000:3.0:1787856861.013750:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436384512 00000100:00100000:3.0:1787856861.013823:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787856861.013843:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436384512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856861.013873:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856861.013972:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436384512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856861.013981:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787856861.014051:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436384512:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856861.073727:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856861.522757:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856861.522782:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436384640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856861.522853:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856861.523197:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436384640 00000100:00100000:0.0:1787856861.523205:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436384640 00000100:00100000:0.0:1787856861.523277:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787856861.523286:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436384640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856861.523323:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787856861.523385:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436384640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856861.523410:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787856861.523794:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436384640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856861.544610:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856861.544836:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426896384 00000100:00100000:0.0:1787856861.544849:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426896384 00000100:00100000:0.0:1787856861.544921:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1787856861.544932:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+18:13186:x1874703426896384:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:0.0:1787856861.545253:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+19:13186:x1874703426896384:12345-192.168.202.6@tcp:35:umount.0 Request processed in 321us (653us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787856861.545262:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00080000:2.0:1787856861.545780:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856861.549968:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856861.551118:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426896640 00000100:00100000:2.0:1787856861.551129:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426896640 00000100:00100000:2.0:1787856861.551547:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1787856861.551560:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+19:13186:x1874703426896640:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:2.0:1787856861.551882:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:898e91b3-529b-44bc-a821-726bff6c71d4+20:13186:x1874703426896640:12345-192.168.202.6@tcp:35:umount.0 Request processed in 319us (1917us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787856861.551891:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1787856861.565764:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856861.566478:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426896896 00000100:00100000:3.0:1787856861.566489:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426896896 00000100:00100000:3.0:1787856861.566740:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1787856861.566752:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d0391450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+20:13186:x1874703426896896:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:3.0:1787856861.567046:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d0391450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+21:13186:x1874703426896896:12345-192.168.202.6@tcp:35:umount.0 Request processed in 295us (1290us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787856861.567055:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:0.0:1787856861.575890:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856861.576034:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426897152 00000100:00100000:3.0:1787856861.576045:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426897152 00000100:00100000:3.0:1787856861.576107:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:3.0:1787856861.576117:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+21:13186:x1874703426897152:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:3.0:1787856861.576433:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:898e91b3-529b-44bc-a821-726bff6c71d4+22:13186:x1874703426897152:12345-192.168.202.6@tcp:35:umount.0 Request processed in 315us (551us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787856861.576441:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1787856861.581720:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856861.581772:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856861.581902:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426897408 00000100:00100000:2.0:1787856861.581911:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426897408 00000100:00100000:2.0:1787856861.581969:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426897280 00000100:00100000:2.0:1787856861.581973:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426897280 00000100:00100000:2.0:1787856861.582008:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:2.0:1787856861.582017:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f992ea53-5038-46c1-bdd9-a3b884b74351+14:2399:x1874703426897408:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856861.582034:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856861.582051:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c9800/0xc25410d92a3c3a2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5df9 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856861.582068:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856861.582115:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f992ea53-5038-46c1-bdd9-a3b884b74351+13:2399:x1874703426897408:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 99us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856861.582122:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:2.0:1787856861.582137:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1787856861.582142:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f992ea53-5038-46c1-bdd9-a3b884b74351+12:2399:x1874703426897280:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856861.582149:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856861.582169:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37d600/0xc25410d92a3c3a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e38 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856861.582178:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856861.582193:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f992ea53-5038-46c1-bdd9-a3b884b74351+11:2399:x1874703426897280:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 52us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856861.582254:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1787856861.589103:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856861.590182:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426897792 00000100:00100000:3.0:1787856861.590194:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426897792 00000100:00100000:3.0:1787856861.590291:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1787856861.590318:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f992ea53-5038-46c1-bdd9-a3b884b74351+11:2400:x1874703426897792:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856861.590335:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856861.590355:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9066007bb200/0xc25410d92a3c3d3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f11 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856861.590373:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856861.590424:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2400:x1874703426897792:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 110us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856861.590431:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1787856861.591429:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856861.591635:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426897920 00000100:00100000:2.0:1787856861.591642:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426897920 00000100:00100000:2.0:1787856861.591714:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:2.0:1787856861.591723:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2398:x1874703426897920:12345-192.168.202.6@tcp:9:umount.0 00000020:00000080:2.0:1787856861.591764:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c407e 00000020:00010000:2.0:1787856861.591773:0:8409:0:(genops.c:1921:obd_stale_export_put()) Put export ffff906601a72000: total 0 00000100:00080000:2.0:1787856861.591778:0:8409:0:(import.c:65:import_set_state_nolock()) ffff906601a70800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787856861.591821:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787856861.591978:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:898e91b3-529b-44bc-a821-726bff6c71d4+5:2398:x1874703426897920:12345-192.168.202.6@tcp:9:umount.0 Request processed in 255us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856861.591986:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00080000:3.0:1787856861.592512:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1787856861.592927:0:6484:0:(genops.c:1907:obd_stale_export_get()) Get export ffff906601a72000: total 0 00010000:00010000:0.0:1787856861.592993:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff906601a72000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787856861.593054:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4436 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60fb expref: 4 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856861.593092:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141db9b4/0xc25410d92a3c4b05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62de expref: 3 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856861.593108:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff906601a72000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787856861.593124:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856861.593127:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856861.593128:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856861.606011:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856861.606294:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426898048 00000100:00100000:2.0:1787856861.606304:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426898048 00000100:00100000:2.0:1787856861.606386:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:2.0:1787856861.606397:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+5:2398:x1874703426898048:12345-192.168.202.6@tcp:9:umount.0 00000020:00000080:2.0:1787856861.606427:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3e08 00000100:00080000:2.0:1787856861.606438:0:8410:0:(import.c:65:import_set_state_nolock()) ffff9064c839b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787856861.606505:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787856861.607042:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:898e91b3-529b-44bc-a821-726bff6c71d4+2:2398:x1874703426898048:12345-192.168.202.6@tcp:9:umount.0 Request processed in 644us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856861.607052:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00010000:00010000:1.0:1787856861.608196:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787856861.609995:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856861.617772:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856861.618060:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426899072 00000100:00100000:2.0:1787856861.618070:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426899072 00000100:00100000:2.0:1787856861.618133:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 258 00000100:00100000:2.0:1787856861.618144:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+22:2398:x1874703426899072:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:2.0:1787856861.618302:0:6497:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3a3b 00000020:00010000:2.0:1787856861.618320:0:6497:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9064c808e800: total 0 00000100:00080000:2.0:1787856861.618325:0:6497:0:(import.c:65:import_set_state_nolock()) ffff9064c8088000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787856861.618346:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1787856861.618623:0:7903:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9064c808e800: total 0 00010000:00010000:1.0:1787856861.618885:0:7903:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9064c808e800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787856861.618928:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856861.618932:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856861.618940:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215bc00/0xc25410d92a3c4ac6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62c9 expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.618959:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856861.618962:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787856861.618966:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c4af0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62d7 expref: 20 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.618980:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856861.618982:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787856861.618987:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c3dde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f3b expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.618998:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:1.0:1787856861.619001:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787856861.619005:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba200/0xc25410d92a3c47a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a61f7 expref: 18 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619016:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:1.0:1787856861.619027:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856861.619032:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bae00/0xc25410d92a3c449f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6117 expref: 17 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619047:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856861.619050:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856861.619053:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c43f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60e6 expref: 16 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619068:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856861.619070:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787856861.619073:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939800/0xc25410d92a3c4421 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60f4 expref: 15 pid: 9124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619097:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9065c46a7200) 00010000:00010000:1.0:1787856861.619100:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787856861.619104:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939400/0xc25410d92a3c40d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6014 expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619121:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9065c3c5fc00) 00010000:00010000:1.0:1787856861.619123:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856861.619127:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938c00/0xc25410d92a3c3d83 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f26 expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619140:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9064c73f6c00) 00010000:00010000:1.0:1787856861.619142:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856861.619146:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938000/0xc25410d92a3c49e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6291 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619181:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9065c3c5fd00) 00010000:00010000:1.0:1787856861.619183:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856861.619187:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c3d67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f1f expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619198:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9065d3599d00) 00010000:00010000:1.0:1787856861.619201:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787856861.619204:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ac00/0xc25410d92a3c44bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a611e expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619248:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9065c5b79e00) 00010000:00010000:1.0:1787856861.619250:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787856861.619254:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601938400/0xc25410d92a3c4317 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a60ae expref: 9 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856861.619266:0:7903:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9064c808e800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787856861.619282:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856861.619284:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856861.619286:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856861.619417:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:898e91b3-529b-44bc-a821-726bff6c71d4+7:2398:x1874703426899072:12345-192.168.202.6@tcp:39:umount.0 Request processed in 1274us (1664us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1787856861.619427:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 258 00000100:00100000:0.0:1787856861.636296:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856861.636486:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426899200 00000100:00100000:2.0:1787856861.636496:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426899200 00000100:00100000:2.0:1787856861.636571:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 259 00000100:00100000:2.0:1787856861.636580:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+5:2398:x1874703426899200:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:2.0:1787856861.636612:0:8909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3a42 00000100:00080000:2.0:1787856861.636629:0:8909:0:(import.c:65:import_set_state_nolock()) ffff9064c808b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787856861.636655:0:8909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787856861.636871:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:898e91b3-529b-44bc-a821-726bff6c71d4+3:2398:x1874703426899200:12345-192.168.202.6@tcp:39:umount.0 Request processed in 291us (587us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787856861.636879:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 259 00000100:00080000:3.0:1787856861.637428:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787856861.637486:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787856862.034893:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787856862.035491:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856862.035514:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436384768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856862.035596:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856862.036073:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436384768 00000100:00100000:0.0:1787856862.036082:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436384768 00000100:00100000:0.0:1787856862.036143:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787856862.036154:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436384768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787856862.036191:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787856862.038113:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436384768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1954us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856862.038126:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787856862.049612:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436384768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787856862.099497:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787856862.548186:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787856862.548194:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787856862.548309:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787856862.548316:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787856863.123094:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856863.719709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856863.719766:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856863.719810:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856863.719908:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426899456 00000100:00100000:3.0:1787856863.719925:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426899456 00000100:00100000:3.0:1787856863.720030:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426899584 00000100:00100000:3.0:1787856863.720035:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426899584 00000100:00100000:3.0:1787856863.720076:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 391 00000100:00100000:3.0:1787856863.720088:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2402:x1874703426899456:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856863.720199:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2402:x1874703426899456:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 113us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856863.720206:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 391 00000100:00100000:3.0:1787856863.720319:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 392 00000100:00100000:3.0:1787856863.720327:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426899584:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787856863.720356:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2402:x1874703426899584:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856863.720362:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 392 00000100:00080000:0.0:1787856863.720556:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856863.720562:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856863.721124:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426899328 00000100:00100000:2.0:1787856863.721131:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426899328 00000100:00100000:2.0:1787856863.721264:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 402 00000100:00100000:2.0:1787856863.721274:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2402:x1874703426899328:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787856863.721336:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f992ea53-5038-46c1-bdd9-a3b884b74351+10:2402:x1874703426899328:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 64us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856863.721355:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 402 00000100:00100000:0.0:1787856864.040844:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856864.041462:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856864.041597:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426899712 00000100:00100000:0.0:1787856864.041610:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426899712 00000100:00100000:0.0:1787856864.041693:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426899840 00000100:00100000:0.0:1787856864.041697:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426899840 00000100:00100000:0.0:1787856864.041727:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:0.0:1787856864.041740:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f992ea53-5038-46c1-bdd9-a3b884b74351+11:2401:x1874703426899712:12345-192.168.202.6@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787856864.041746:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00010000:00010000:0.0:1787856864.041762:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787856864.041765:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601989a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f992ea53-5038-46c1-bdd9-a3b884b74351+11:2401:x1874703426899840:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856864.041780:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856864.041795:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906601938e00/0xc25410d92a3c3b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e4d expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856864.041799:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076bc00/0xc25410d92a3c3b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e7e expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856864.041829:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856864.041843:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856864.042006:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f992ea53-5038-46c1-bdd9-a3b884b74351+9:2401:x1874703426899712:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 268us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856864.042010:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601989a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f992ea53-5038-46c1-bdd9-a3b884b74351+9:2401:x1874703426899840:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 248us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856864.042021:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1787856864.042042:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1787856864.042770:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856864.042856:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426899968 00000100:00100000:2.0:1787856864.042862:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426899968 00000100:00100000:2.0:1787856864.042909:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:2.0:1787856864.042918:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f992ea53-5038-46c1-bdd9-a3b884b74351+8:2401:x1874703426899968:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787856864.042930:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856864.042942:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076a600/0xc25410d92a3c3d36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5f0a expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856864.042955:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856864.042981:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f992ea53-5038-46c1-bdd9-a3b884b74351+7:2401:x1874703426899968:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856864.042989:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:0.0:1787856864.049412:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856864.049528:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426900224 00000100:00100000:1.0:1787856864.049540:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426900224 00000100:00100000:1.0:1787856864.050204:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 260 00000100:00100000:1.0:1787856864.050278:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+6:2398:x1874703426900224:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:1.0:1787856864.050333:0:6496:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3b53 00000020:00010000:1.0:1787856864.050346:0:6496:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9064c802c000: total 0 00000100:00080000:1.0:1787856864.050352:0:6496:0:(import.c:65:import_set_state_nolock()) ffff9064c802a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787856864.050386:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1787856864.050802:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2398:x1874703426900224:12345-192.168.202.6@tcp:39:umount.0 Request processed in 529us (1403us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1787856864.050812:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 260 00000020:00010000:0.0:1787856864.051187:0:6484:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9064c802c000: total 0 00010000:00010000:0.0:1787856864.051194:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856864.051308:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9064c802c000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787856864.051357:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5490f00) 00010000:00010000:0.0:1787856864.051361:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787856864.051371:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c13c8e00/0xc25410d92a3c4b13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62e5 expref: 4 pid: 8909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856864.051398:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9064c802c000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787856864.051413:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856864.051415:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856864.051417:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856864.077713:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856864.087528:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426900352 00000100:00100000:3.0:1787856864.087548:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426900352 00000100:00100000:3.0:1787856864.087653:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 261 00000100:00100000:3.0:1787856864.087666:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+5:2398:x1874703426900352:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:3.0:1787856864.087725:0:8909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3b5a 00000100:00080000:3.0:1787856864.087740:0:8909:0:(import.c:65:import_set_state_nolock()) ffff9064c802b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787856864.087772:0:8909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787856864.088019:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb+3:2398:x1874703426900352:12345-192.168.202.6@tcp:39:umount.0 Request processed in 354us (10321us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787856864.088028:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 261 00010000:00010000:0.0:1787856864.088407:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856864.126785:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856864.126969:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426900608 00000100:00100000:2.0:1787856864.126981:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426900608 00000100:00100000:2.0:1787856864.127117:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 403 00000100:00100000:2.0:1787856864.127131:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+7:2398:x1874703426900608:12345-192.168.202.6@tcp:251:umount.0 00000020:00000080:2.0:1787856864.127198:0:6490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3a18 00000020:00010000:2.0:1787856864.127211:0:6490:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90660191c000: total 0 00000100:00080000:2.0:1787856864.127285:0:6490:0:(import.c:65:import_set_state_nolock()) ffff90660191e800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787856864.127320:0:7903:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90660191c000: total 0 00000100:00100000:2.0:1787856864.127387:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f992ea53-5038-46c1-bdd9-a3b884b74351+3:2398:x1874703426900608:12345-192.168.202.6@tcp:251:umount.0 Request processed in 259us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856864.127395:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 403 00010000:00010000:1.0:1787856864.127401:0:7903:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90660191c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787856864.127703:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c3a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a5e3f expref: 2 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856864.127728:0:7903:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90660191c000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787856864.127743:0:7903:0:(genops.c:885:class_export_put()) final put ffff90660191c000/f992ea53-5038-46c1-bdd9-a3b884b74351 00010000:00010000:1.0:1787856864.127758:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856864.127760:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856864.127762:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787856864.127805:0:14203:0:(genops.c:844:class_export_destroy()) destroying export ffff90660191c000/f992ea53-5038-46c1-bdd9-a3b884b74351 for MGS 00000020:00000080:3.0:1787856864.127852:0:14203:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90660191e800 for MGS 00010000:00010000:0.0:1787856864.146614:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856865.171121:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856865.618181:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436384896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856865.618311:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.618402:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436385024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856865.618456:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.618496:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436384896 00000100:00100000:2.0:1787856865.618504:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436384896 00000100:00100000:2.0:1787856865.618564:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436385024 00000100:00100000:2.0:1787856865.618568:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436385024 00000100:00100000:2.0:1787856865.618587:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787856865.618598:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436384896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787856865.618639:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787856865.618689:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436384896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.618698:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787856865.618718:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787856865.618724:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436385024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856865.618742:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856865.618774:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436385024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.618781:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1787856865.618804:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787856865.618809:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856865.618851:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436385024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787856865.618884:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436384896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787856865.619652:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436385152:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.619697:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.619740:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436385664:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.619768:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.619799:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436386176:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.619826:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.619852:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787856865.619859:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436385536:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.619884:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.619901:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436386048:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.619922:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.619951:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436385664 00000100:00100000:2.0:1787856865.619956:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436385664 00000100:00100000:2.0:1787856865.619993:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787856865.620000:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436385664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620044:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436385664:12345-0@lo:400:kworker.0 Request processed in 45us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.620052:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787856865.620076:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436386176 00000100:00100000:2.0:1787856865.620079:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436386176 00000100:00100000:2.0:1787856865.620112:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436385536 00000100:00100000:2.0:1787856865.620115:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436385536 00000100:00100000:2.0:1787856865.620133:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436386048 00000100:00100000:2.0:1787856865.620136:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436386048 00000100:00100000:2.0:1787856865.620151:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787856865.620157:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436386176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620188:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436386176:12345-0@lo:400:kworker.0 Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.620195:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787856865.620208:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787856865.620247:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436385536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620289:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436385536:12345-0@lo:400:kworker.0 Request processed in 75us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.620295:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787856865.620307:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787856865.620313:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436386048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620337:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436386048:12345-0@lo:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.620344:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787856865.620373:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436385280:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620400:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.620417:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436385792:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620455:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.620474:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436386304:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620497:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.620514:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787856865.620520:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436385408:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620544:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.620559:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436385920:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620581:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.620596:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436386432:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620623:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856865.620654:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436385792 00000100:00100000:2.0:1787856865.620658:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436385792 00000100:00100000:2.0:1787856865.620688:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436386432 00000100:00100000:2.0:1787856865.620691:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436386432 00000100:00100000:2.0:1787856865.620723:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787856865.620729:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436385792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620767:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436385792:12345-0@lo:400:kworker.0 Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.620773:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787856865.620785:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787856865.620791:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436386432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620815:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436386432:12345-0@lo:400:kworker.0 Request processed in 24us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.620820:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787856865.620849:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436385280 00000100:00100000:2.0:1787856865.620852:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436385280 00000100:00100000:2.0:1787856865.620868:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436386304 00000100:00100000:2.0:1787856865.620871:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436386304 00000100:00100000:2.0:1787856865.620883:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436385920 00000100:00100000:2.0:1787856865.620886:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436385920 00000100:00100000:2.0:1787856865.620899:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787856865.620905:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436385280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620937:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436385280:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.620944:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787856865.620955:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1787856865.620962:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436386304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.620989:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436386304:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.620995:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1787856865.621005:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787856865.621018:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436385920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621043:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436385920:12345-0@lo:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.621050:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:2.0:1787856865.621068:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787856865.621073:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787856865.621076:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787856865.621078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856865.621086:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436385408 00000100:00100000:2.0:1787856865.621090:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436385408 00000100:00100000:2.0:1787856865.621109:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787856865.621115:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436385408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621143:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436385408:12345-0@lo:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856865.621149:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787856865.621196:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436385408:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621208:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436385920:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621245:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436386432:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621256:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436385280:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621266:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436385792:0@lo:400:kworker.0 00010000:00080000:2.0:1787856865.621279:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90660193fc00 x1874703436386304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856865.621290:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436386304:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621338:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436385536:0@lo:400:kworker.0 00010000:00080000:2.0:1787856865.621359:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c826ed00 x1874703436386048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856865.621369:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436386048:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621379:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436385664:0@lo:400:kworker.0 00000100:00100000:2.0:1787856865.621390:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436386176:0@lo:400:kworker.0 00000100:00100000:3.0:1787856865.621504:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436385152 00000100:00100000:3.0:1787856865.621510:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436385152 00000100:00100000:3.0:1787856865.621550:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1787856865.621558:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436385152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856865.621609:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c911024a-9030-4ea8-a782-9255ee9580a7+24:3626:x1874703436385152:12345-0@lo:400:kworker.0 Request processed in 52us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856865.621617:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1787856865.621665:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436385152:0@lo:400:kworker.0 00000100:00100000:3.0:1787856865.624066:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856865.624092:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066019883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436386560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856865.624176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856865.624382:0:10075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436386560 00000100:00100000:3.0:1787856865.624391:0:10075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436386560 00000100:00100000:3.0:1787856865.624458:0:10075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787856865.624468:0:10075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436386560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787856865.624495:0:10075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787856865.624547:0:10075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436386560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856865.624555:0:10075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787856865.624614:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066019883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436386560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856866.133119:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856866.133145:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436386688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856866.133231:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856866.134414:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436386688 00000100:00100000:3.0:1787856866.134432:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436386688 00000100:00100000:3.0:1787856866.134482:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787856866.134490:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436386688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856866.134512:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787856866.134573:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436386688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856866.134581:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787856866.134628:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436386688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787856866.193451:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787856866.507643:0:15185:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787856866.543370:0:15185:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787856866.543461:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.543481:0:15185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.543488:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.543495:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.543522:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787856866.543529:0:15185:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787856866.543562:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787856866.543567:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787856866.543574:0:15185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787856866.543604:0:15185:0:(import.c:65:import_set_state_nolock()) ffff9065f71f9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787856866.543689:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856866.543698:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856866.543705:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274aa00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856866.543709:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856866.543719:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856866.543726:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856866.543744:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787856866.543747:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787856866.543750:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787856866.543786:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856866.543792:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787856866.543948:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436386944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856866.544053:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787856866.544141:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856866.544150:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274aa00/0xc25410d92a3c3ace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856866.544165:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856866.544167:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856866.544182:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856866.544881:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436386816:0@lo:39:umount.0 00000100:00100000:1.0:1787856866.544924:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856866.545603:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436386816 00000100:00100000:3.0:1787856866.545624:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436386816 00000100:00100000:3.0:1787856866.545692:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787856866.545703:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066019883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874703436386816:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787856866.545755:0:6498:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c362f 00000100:00080000:3.0:1787856866.545767:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9065e85d9800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787856866.545880:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066019883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3622:x1874703436386816:12345-0@lo:39:umount.0 Request processed in 179us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856866.545889:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1787856866.545901:0:6498:0:(genops.c:885:class_export_put()) final put ffff9065e85d8000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787856866.545953:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065f71f9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787856866.545966:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436386816:0@lo:39:umount.0 00010000:00010000:0.0:1787856866.547694:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856866.550604:0:13165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436386944 00000100:00100000:2.0:1787856866.550623:0:13165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436386944 00000100:00100000:2.0:1787856866.550700:0:13165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787856866.550712:0:13165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+24:3623:x1874703436386944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787856866.550733:0:13165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856866.550759:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ff800/0xc25410d92a3c3ad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3ace expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.550783:0:13165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856866.551044:0:13165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c911024a-9030-4ea8-a782-9255ee9580a7+23:3623:x1874703436386944:12345-0@lo:103:ldlm_bl.0 Request processed in 334us (6990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856866.551053:0:13165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:2.0:1787856866.551096:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065e85d8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787856866.551165:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065e85d9800 for lustre-MDT0000 00000100:00080000:2.0:1787856866.551191:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787856866.551197:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787856866.551203:0:15185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787856866.551505:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436386944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787856866.554544:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.554567:0:15185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.554575:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.554582:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.554863:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787856866.554872:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.554881:0:15185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.554888:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.554896:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.555641:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856866.555652:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.555672:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274be00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856866.555677:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.555685:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856866.555694:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856866.555715:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787856866.555719:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787856866.555764:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.555771:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856866.555803:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557075:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787856866.557119:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436387072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856866.557236:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787856866.557325:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557335:0:15185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557342:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557349:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557381:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787856866.557388:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557395:0:15185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557400:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557407:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856866.557414:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1787856866.557430:0:15185:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787856866.557438:0:15185:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787856866.557487:0:15185:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787856866.557491:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787856866.557497:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787856866.557506:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787856866.557512:0:15185:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9064c6889800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787856866.557519:0:15185:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9065fe840000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787856866.557524:0:15185:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90660043e800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787856866.557529:0:15185:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9065fd620800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787856866.557537:0:15185:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9064c802c000 fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 192.168.202.6@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787856866.557543:0:15185:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9064c808e800 898e91b3-529b-44bc-a821-726bff6c71d4 192.168.202.6@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1787856866.557555:0:15185:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9065c4f38000) has exports, disconnecting them 00000020:00080000:2.0:1787856866.557560:0:15185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9064c6889800), last request at 1787856865 00000020:00000080:2.0:1787856866.557568:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c393f 00000100:00080000:2.0:1787856866.557586:0:15185:0:(import.c:65:import_set_state_nolock()) ffff9064c688f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787856866.557638:0:15185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9064c6889800): rc 0 00000020:00000080:2.0:1787856866.557640:0:15185:0:(genops.c:885:class_export_put()) final put ffff9064c6889800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787856866.557651:0:15185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9065fe840000), last request at 1787856865 00000020:00000080:2.0:1787856866.557654:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3858 00000100:00080000:2.0:1787856866.557660:0:15185:0:(import.c:65:import_set_state_nolock()) ffff9065fe841000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787856866.557671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c6889800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787856866.557719:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c688f800 for lustre-MDT0000 00000020:00080000:2.0:1787856866.557734:0:15185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9065fe840000): rc 0 00000020:00000080:2.0:1787856866.557736:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065fe840000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787856866.557742:0:15185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90660043e800), last request at 1787856616 00000020:00000080:2.0:1787856866.557745:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3716 00000100:00080000:2.0:1787856866.557749:0:15185:0:(import.c:65:import_set_state_nolock()) ffff90660043d800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787856866.557757:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe840000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787856866.557783:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065fe841000 for lustre-MDT0000 00000020:00080000:2.0:1787856866.557795:0:15185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90660043e800): rc 0 00000020:00000080:2.0:1787856866.557797:0:15185:0:(genops.c:885:class_export_put()) final put ffff90660043e800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787856866.557803:0:15185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9065fd620800), last request at 1787856616 00000020:00000080:2.0:1787856866.557806:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c36d7 00000100:00080000:2.0:1787856866.557828:0:15185:0:(import.c:65:import_set_state_nolock()) ffff906600439000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787856866.557837:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90660043e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787856866.557867:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90660043d800 for lustre-MDT0000 00000001:00000004:2.0:1787856866.557882:0:15185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:1.0:1787856866.558356:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274be00/0xc25410d92a3c3adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558375:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787856866.558381:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558388:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856866.558392:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558412:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856866.558433:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856866.558439:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787856866.558442:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787856866.558444:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787856866.558478:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558484:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856866.558521:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558528:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076b000/0xc25410d92a3c39d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c39d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558537:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856866.558540:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558545:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a400 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856866.558548:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558553:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856866.558569:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856866.558574:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787856866.558576:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787856866.558578:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787856866.558593:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558598:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856866.558604:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558610:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076a400/0xc25410d92a3c3d28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558619:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856866.558623:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558629:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c13c9a00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856866.558631:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558636:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856866.558642:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856866.558657:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787856866.558659:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787856866.558661:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787856866.558673:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558678:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856866.558688:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558695:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c358e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3595 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.558705:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856866.558706:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856866.558708:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856866.558724:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066019892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436387456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856866.558774:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856866.558863:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856866.558881:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436387072 00000100:00100000:1.0:1787856866.558890:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436387072 00000100:00100000:1.0:1787856866.558941:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436387456 00000100:00100000:1.0:1787856866.558946:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436387456 00000100:00100000:1.0:1787856866.558971:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787856866.558981:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+24:3624:x1874703436387072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856866.558996:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856866.559010:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37d000/0xc25410d92a3c3ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3adc expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.559035:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856866.559071:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+23:3624:x1874703436387072:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856866.559078:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787856866.559095:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787856866.559100:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+22:3623:x1874703436387456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856866.559107:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856866.559116:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37ce00/0xc25410d92a3c3595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c358e expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.559124:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856866.559147:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c911024a-9030-4ea8-a782-9255ee9580a7+21:3623:x1874703436387456:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856866.559153:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787856866.559188:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066019892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436387456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856866.559247:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601989e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436387328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856866.559271:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856866.559295:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856866.559302:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436387200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856866.559323:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856866.559350:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436387328 00000100:00100000:1.0:1787856866.559354:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436387328 00000100:00100000:1.0:1787856866.559378:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436387200 00000100:00100000:1.0:1787856866.559380:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436387200 00000100:00100000:1.0:1787856866.559396:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787856866.559403:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066019892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c911024a-9030-4ea8-a782-9255ee9580a7+22:3626:x1874703436387328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856866.560000:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856866.560014:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076ae00/0xc25410d92a3c3d2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3d28 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.560024:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856866.560063:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066019892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c911024a-9030-4ea8-a782-9255ee9580a7+21:3626:x1874703436387328:12345-0@lo:103:ldlm_bl.0 Request processed in 660us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856866.560070:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787856866.560087:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856866.560094:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c911024a-9030-4ea8-a782-9255ee9580a7+20:3626:x1874703436387200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856866.560102:0:13166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856866.560111:0:13166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076aa00/0xc25410d92a3c39d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c39d2 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856866.560118:0:13166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856866.560138:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c911024a-9030-4ea8-a782-9255ee9580a7+19:3626:x1874703436387200:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856866.560143:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856866.560200:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436387200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856866.560208:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601989e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436387328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856866.560767:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436387072:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787856866.561033:0:15185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9065fd620800): rc 0 00000004:00000080:2.0:1787856866.561043:0:15185:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae99c1a33ae0 00000100:00080000:2.0:1787856866.561067:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787856866.561071:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1787856866.562112:0:15185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787856866.562145:0:15185:0:(import.c:65:import_set_state_nolock()) ffff9065fd627000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787856866.562268:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856866.562398:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436387584:0@lo:39:umount.0 00000100:00100000:3.0:1787856866.562487:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856866.565202:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436387584 00000100:00100000:2.0:1787856866.565244:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436387584 00000100:00100000:2.0:1787856866.565323:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787856866.565335:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874703436387584:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787856866.565370:0:6501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3771 00000100:00080000:2.0:1787856866.565379:0:6501:0:(import.c:65:import_set_state_nolock()) ffff90660060f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787856866.565915:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787856866.566201:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3622:x1874703436387584:12345-0@lo:39:umount.0 Request processed in 868us (3713us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787856866.566211:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00010000:2.0:1787856866.566303:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787856866.566365:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787856866.566369:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787856866.566385:0:15185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787856866.566468:0:15185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787856866.566487:0:15185:0:(import.c:65:import_set_state_nolock()) ffff9064c5e78000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787856866.566508:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787856866.566510:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787856866.566527:0:15185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787856866.566591:0:15185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787856866.566600:0:15185:0:(import.c:65:import_set_state_nolock()) ffff9064c808a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787856866.566643:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9065c4f38000) has no exports 00000001:00100000:2.0:1787856866.575740:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000001:00080000:2.0:1787856866.575756:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787856866.575762:0:6475:0:(genops.c:885:class_export_put()) final put ffff9064c802c000/fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000001:00100000:2.0:1787856866.575777:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000001:00080000:2.0:1787856866.575786:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787856866.575797:0:6475:0:(genops.c:885:class_export_put()) final put ffff9064c808e800/898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:2.0:1787856866.575816:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c802c000/fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb for lustre-MDT0000 00000020:00000080:2.0:1787856866.575865:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c808e800/898e91b3-529b-44bc-a821-726bff6c71d4 for lustre-MDT0000 00000020:00000080:2.0:1787856866.575892:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c802a800 for lustre-MDT0000 00000020:00000080:2.0:1787856866.575896:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c8088000 for lustre-MDT0000 00000100:00080000:3.0:1787856866.582264:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065fd627000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787856866.582279:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436387584:0@lo:39:umount.0 00000100:00100000:3.0:1787856866.582328:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436387712:0@lo:9:umount.0 00000100:00100000:3.0:1787856866.582407:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856866.582448:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436387840:0@lo:9:umount.0 00000100:00100000:3.0:1787856866.582473:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856866.582635:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436387712 00000100:00100000:0.0:1787856866.582642:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436387712 00000100:00100000:0.0:1787856866.582695:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436387840 00000100:00100000:0.0:1787856866.582698:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436387840 00000100:00100000:0.0:1787856866.582721:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787856866.582729:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874703436387712:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787856866.582768:0:10490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c387b 00000100:00080000:0.0:1787856866.582776:0:10490:0:(import.c:65:import_set_state_nolock()) ffff9064c6899800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787856866.582819:0:10490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787856866.582943:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3622:x1874703436387712:12345-0@lo:9:umount.0 Request processed in 214us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856866.582951:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787856866.582968:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787856866.582975:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874703436387840:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787856866.582987:0:10490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3a11 00000100:00080000:0.0:1787856866.582992:0:10490:0:(import.c:65:import_set_state_nolock()) ffff9064c5e7c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787856866.583015:0:10490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1787856866.583087:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3622:x1874703436387840:12345-0@lo:9:umount.0 Request processed in 112us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856866.583094:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1787856866.583116:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856866.583122:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787856866.584687:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c5e78000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787856866.584704:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787856866.584706:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787856866.584710:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436387712:0@lo:9:umount.0 00000100:00080000:2.0:1787856866.584740:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c808a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787856866.584753:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787856866.584755:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787856866.584758:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436387840:0@lo:9:umount.0 00000020:00080000:0.0:1787856866.614526:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9065c4f38000) has no exports 00000020:00000080:0.0:1787856866.738212:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c35e9 00000020:00000080:0.0:1787856866.738587:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065e85d2800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787856866.738651:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787856866.738884:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856866.738897:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787856866.738901:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9065ea7b19d0) has no exports 00000020:00000080:1.0:1787856866.739256:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c35e2 00000020:00000080:1.0:1787856866.739263:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c4694000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787856866.740705:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065e85d2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787856866.740907:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c4694000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787856866.741123:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856866.741134:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787856866.741156:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c4691800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787856866.741159:0:15185:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c4691800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787856866.741167:0:15185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1787856867.155361:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787856867.155386:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436387968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856867.155476:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856867.155929:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436387968 00000100:00100000:0.0:1787856867.155937:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436387968 00000100:00100000:0.0:1787856867.155976:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787856867.155984:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601989e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3623:x1874703436387968:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787856867.155992:0:6502:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787856867.156041:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601989e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3623:x1874703436387968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (564us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787856867.156048:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:02020000:0.0:1787856867.156095:0:3623:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:1.0:1787856867.162012:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787856867.162029:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1787856867.162035:0:7428:0:(genops.c:885:class_export_put()) final put ffff9065fe6d0000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787856867.162052:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000001:00080000:1.0:1787856867.162058:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1787856867.162060:0:7428:0:(genops.c:885:class_export_put()) final put ffff9064c802c800/fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb 00000001:00100000:1.0:1787856867.162066:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000001:00080000:1.0:1787856867.162070:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1787856867.162072:0:7428:0:(genops.c:885:class_export_put()) final put ffff9064c808d800/898e91b3-529b-44bc-a821-726bff6c71d4 00000001:00100000:1.0:1787856867.162539:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787856867.162543:0:9490:0:(genops.c:885:class_export_put()) final put ffff9064c688c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787856867.162554:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:1.0:1787856867.162556:0:9490:0:(genops.c:885:class_export_put()) final put ffff906601a72000/898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:2.0:1787856867.162719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe6d0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787856867.162782:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c802c800/fc3fb7a6-6e1c-4786-b13a-79d060c2d3eb for lustre-MDT0001 00000020:00000080:2.0:1787856867.162804:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c808d800/898e91b3-529b-44bc-a821-726bff6c71d4 for lustre-MDT0001 00000020:00000080:2.0:1787856867.162832:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c688c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787856867.162850:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff906601a72000/898e91b3-529b-44bc-a821-726bff6c71d4 for lustre-OST0001 00000020:00000080:2.0:1787856867.162871:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90660060f800 for lustre-MDT0001 00000020:00000080:2.0:1787856867.162886:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c802b000 for lustre-MDT0001 00000020:00000080:2.0:1787856867.162890:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c808b000 for lustre-MDT0001 00000020:00000080:2.0:1787856867.162894:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c5e7c000 for lustre-OST0001 00000020:00000080:2.0:1787856867.162899:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff906601a70800 for lustre-OST0001 00000001:00100000:3.0:1787856867.164996:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787856867.165004:0:8402:0:(genops.c:885:class_export_put()) final put ffff9064c689a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787856867.165057:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:3.0:1787856867.165060:0:8402:0:(genops.c:885:class_export_put()) final put ffff9064c8399000/898e91b3-529b-44bc-a821-726bff6c71d4 00000020:00000080:2.0:1787856867.165082:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c689a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787856867.165291:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c6899800 for lustre-OST0000 00000020:00000080:2.0:1787856867.165528:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c8399000/898e91b3-529b-44bc-a821-726bff6c71d4 for lustre-OST0000 00000020:00000080:2.0:1787856867.165629:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c839b000 for lustre-OST0000 00000100:00080000:0.0:1787856867.177467:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787856867.177477:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9065c46e8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787856867.177482:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787856867.205618:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9065c46e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787856867.205632:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 149 00000100:00080000:0.0:1787856867.205642:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9065c46e8000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856867.207320:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c82412c0 x1874703436388096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787856867.207897:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436388096:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787856867.207972:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856867.208511:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436388096 00000100:00100000:0.0:1787856867.208520:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436388096 00000100:00100000:0.0:1787856867.208564:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787856867.208572:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874703436388096:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787856867.208588:0:6502:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787856867.214525:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874703436388096:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 5943us (6543us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787856867.214543:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:2.0:1787856867.214651:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065c46e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856867.214657:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787856867.214661:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436388096:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1787856867.218404:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856868.244173:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856869.267420:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856870.293603:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787856870.738068:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787856870.738078:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787856870.738101:0:38:0:(import.c:65:import_set_state_nolock()) ffff9065c46e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856870.738112:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1787856870.738119:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787856870.738128:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9065c46e8000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856870.738159:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90660193cb40 x1874703436388352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787856870.738304:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436388736:0@lo:400:kworker.0 00000100:00100000:3.0:1787856870.738406:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856870.738480:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436389248:0@lo:400:kworker.0 00000100:00100000:0.0:1787856870.738656:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436388224:0@lo:400:kworker.0 00000100:00100000:0.0:1787856870.738701:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856870.738729:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436388864:0@lo:400:kworker.0 00000100:00100000:0.0:1787856870.738777:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436388352:0@lo:38:kworker.0 00000100:00100000:0.0:1787856870.738808:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856870.738857:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436388608:0@lo:400:kworker.0 00000100:00100000:0.0:1787856870.738894:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856870.738914:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436389120:0@lo:400:kworker.0 00000100:00100000:0.0:1787856870.738935:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856870.738981:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436388736 00000100:00100000:0.0:1787856870.738989:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436388736 00000100:00100000:0.0:1787856870.739045:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436388608 00000100:00100000:0.0:1787856870.739048:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436388608 00000100:00100000:0.0:1787856870.739059:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436389120 00000100:00100000:0.0:1787856870.739061:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436389120 00000100:00100000:0.0:1787856870.739079:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787856870.739088:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436388736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856870.739136:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436388736:12345-0@lo:400:kworker.0 Request processed in 50us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856870.739144:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787856870.739162:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787856870.739168:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436389120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856870.739200:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436389120:12345-0@lo:400:kworker.0 Request processed in 32us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856870.739206:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787856870.739239:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787856870.739245:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3623:x1874703436388608:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787856870.739251:0:6497:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787856870.739276:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3623:x1874703436388608:12345-0@lo:400:kworker.0 Request processed in 30us (382us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787856870.739281:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1787856870.739327:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787856870.739331:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787856870.739341:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787856870.739804:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787856870.739854:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90660193e940 x1874703436388736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856870.739870:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436388736:0@lo:400:kworker.0 00000100:00100000:3.0:1787856870.739910:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436389248 00000100:00100000:3.0:1787856870.739914:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436389248 00000100:00100000:3.0:1787856870.739949:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787856870.739956:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436389248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856870.739992:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436389248:12345-0@lo:400:kworker.0 Request processed in 38us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856870.739998:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787856870.740016:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856870.740034:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787856870.740042:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436388480:0@lo:400:kworker.0 00000100:00100000:3.0:1787856870.740063:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856870.740076:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436388992:0@lo:400:kworker.0 00000100:00100000:3.0:1787856870.740104:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856870.740124:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436388864 00000100:00100000:3.0:1787856870.740127:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436388864 00000100:00100000:3.0:1787856870.740152:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787856870.740158:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436388864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856870.740193:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436388864:12345-0@lo:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856870.740199:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787856870.740214:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436388480 00000100:00100000:3.0:1787856870.740235:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436388480 00000100:00100000:3.0:1787856870.740252:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436388992 00000100:00100000:3.0:1787856870.740255:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436388992 00000100:00100000:3.0:1787856870.740264:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787856870.740269:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3625:x1874703436388480:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787856870.740273:0:8909:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787856870.742328:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787856870.742345:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1874703436388992:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787856870.742358:0:6497:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787856870.742543:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436388224 00000100:00100000:2.0:1787856870.742553:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436388224 00000100:00100000:2.0:1787856870.742613:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787856870.742620:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:3625:x1874703436388224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856870.742702:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3625:x1874703436388480:12345-0@lo:400:kworker.0 Request processed in 2429us (2634us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787856870.742711:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1787856870.742779:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787856870.742786:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90660050d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787856870.742791:0:3625:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787856870.742797:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90660050d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856870.742802:0:3625:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 150 00000100:00080000:3.0:1787856870.742810:0:3625:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90660050d000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856870.742849:0:3625:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3fc00 x1874703436389376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787856870.742902:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436388480:0@lo:400:kworker.0 00000100:00100000:3.0:1787856870.742929:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436388864:0@lo:400:kworker.0 00000100:00080000:3.0:1787856870.742984:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787856870.742990:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787856870.742994:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856870.743007:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436388352 00000100:00100000:3.0:1787856870.743012:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436388352 00000100:00100000:3.0:1787856870.743041:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787856870.743059:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436388352:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787856870.743079:0:6501:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787856870.750705:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1874703436388992:12345-0@lo:400:kworker.0 Request processed in 8344us (10582us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787856870.750727:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787856870.750838:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436389248:0@lo:400:kworker.0 00000100:00100000:1.0:1787856870.750912:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874703436389376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787856870.750986:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856870.751140:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436389632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856870.751187:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856870.751211:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856870.751237:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601989a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436389504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856870.751262:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856870.751506:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436389632 00000100:00100000:1.0:1787856870.751526:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436389632 00000100:00100000:1.0:1787856870.751580:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436389504 00000100:00100000:1.0:1787856870.751584:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436389504 00000100:00100000:1.0:1787856870.751604:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787856870.751612:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601988f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436389632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787856870.751648:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787856870.751696:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601988f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436389632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856870.751703:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787856870.751721:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787856870.751727:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066019892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436389504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856870.751744:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787856870.751769:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066019892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436389504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856870.751775:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1787856870.751810:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787856870.751816:0:3625:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787856870.751820:0:3625:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787856870.751826:0:3625:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856870.751839:0:3625:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 192 00000100:00080000:1.0:1787856870.751846:0:3625:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9064c723f800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856870.751873:0:3625:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90660198b840 x1874703436389760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856870.751895:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436388992:0@lo:400:kworker.0 00000100:00100000:1.0:1787856870.751930:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601989a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436389504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856870.751942:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436389632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856870.751960:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436389760:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787856870.751983:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856870.752026:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436389376 00000100:00100000:1.0:1787856870.752030:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436389376 00000100:00100000:1.0:1787856870.752049:0:9124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436389760 00000100:00100000:1.0:1787856870.752051:0:9124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436389760 00000100:00100000:1.0:1787856870.752063:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787856870.752068:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1874703436389376:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787856870.752084:0:9124:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787856870.752120:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1874703436389376:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 51us (1134us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787856870.752126:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787856870.752137:0:9124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787856870.752141:0:9124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1874703436389760:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787856870.752147:0:9124:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787856870.752183:0:9124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1874703436389760:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 40us (199us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787856870.752189:0:9124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1787856870.752239:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856870.752244:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856870.752247:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660198b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436389760:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787856870.752258:0:3622:0:(import.c:65:import_set_state_nolock()) ffff90660050d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856870.752260:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856870.752263:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874703436389376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787856870.752670:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e9fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c911024a-9030-4ea8-a782-9255ee9580a7+19:3625:x1874703436388224:12345-0@lo:400:kworker.0 Request processed in 10049us (13966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856870.752682:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787856870.752717:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436388224:0@lo:400:kworker.0 00000100:00080000:0.0:1787856870.759154:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787856870.759182:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 169 00000100:00080000:0.0:1787856870.759196:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9064c6898800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856870.763855:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c8240b40 x1874703436389888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787856870.763899:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436388608:0@lo:400:kworker.0 00010000:00080000:0.0:1787856870.763949:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90660193cf00 x1874703436389120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856870.763961:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436389120:0@lo:400:kworker.0 00000100:00100000:1.0:1787856870.764793:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436389888:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787856870.764892:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856870.765129:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436389888 00000100:00100000:0.0:1787856870.765138:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436389888 00000100:00100000:0.0:1787856870.765206:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787856870.765247:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660198b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874703436389888:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787856870.765270:0:6497:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787856870.765646:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660198b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874703436389888:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 428us (753us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787856870.765656:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1787856870.765736:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856870.765741:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856870.765745:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436389888:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787856870.792793:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436388352:12345-0@lo:38:kworker.0 Request processed in 49729us (53967us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787856870.792814:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:1.0:1787856870.792997:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065c46e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856870.793003:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856870.793007:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436388352:0@lo:38:kworker.0 00010000:00010000:0.0:1787856871.316686:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787856872.275312:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1787856872.284258:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787856872.284268:0:6475:0:(genops.c:885:class_export_put()) final put ffff9065fd620800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787856872.284564:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fd620800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787856872.284643:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff906600439000 for lustre-MDT0000 00010000:00010000:2.0:1787856872.339945:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787856872.785502:0:15185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9064c79af5a0 - data ffff9065eb31a360/ffff9064c80c8c00 00000020:01000000:1.0:1787856872.785657:0:15185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9065c2e05960 - data ffff9065c9771a20/ffff9065e85fc400 00000001:00000004:1.0:1787856872.803741:0:15185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1787856872.909139:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787856872.909148:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787856872.909162:0:15185:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9064c81bc3c0 x1874703436387584/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787856876 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856872.909190:0:15185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787856872.930381:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787856872.930390:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1787856872.930403:0:15185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787856872.930406:0:15185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787856872.933136:0:8429:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787856872.933143:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787856872.933156:0:8429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787856872.934974:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787856872.934981:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1787856872.935001:0:15185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787856872.935022:0:15185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787856872.936120:0:9840:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787856872.936125:0:9840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787856872.936135:0:9840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787856872.939800:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c35b1 00000020:00000080:0.0:1787856872.939813:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c661f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787856872.940055:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c661f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787856872.949144:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c35c6 00000020:00000080:0.0:1787856872.949157:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c46ef800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787856872.949240:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787856872.949246:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787856872.949255:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787856872.949259:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9065c4f3cd70) has no exports 00000004:01000000:0.0:1787856872.949473:0:15185:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787856872.949483:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c39fc 00000020:00000080:0.0:1787856872.949489:0:15185:0:(genops.c:885:class_export_put()) final put ffff9064c688e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787856872.950158:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c46ef800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787856872.950557:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787856872.950564:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787856872.950578:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787856872.950582:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9064c8084d70) has no exports 00000020:00000080:0.0:1787856872.950591:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c39f5 00000020:00000080:0.0:1787856872.950597:0:15185:0:(genops.c:885:class_export_put()) final put ffff9064c808b800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787856872.950940:0:15185:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787856872.950945:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787856872.950949:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1787856872.951864:0:15185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787856872.951869:0:15185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787856872.951916:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787856872.951927:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787856872.951934:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c380b 00000020:00000080:0.0:1787856872.951941:0:15185:0:(genops.c:885:class_export_put()) final put ffff9064c5e7d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787856872.951946:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787856872.951951:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787856872.951955:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787856872.952082:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 19 (ffff9065fe714d70) has no exports 00000020:00000080:0.0:1787856872.952089:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3804 00000020:00000080:0.0:1787856872.952094:0:15185:0:(genops.c:885:class_export_put()) final put ffff9064c5e7f000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787856872.957735:0:15185:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787856872.957743:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787856872.957747:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1787856872.957756:0:15185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787856872.957758:0:15185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787856872.957799:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787856872.957813:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787856872.957827:0:15185:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787856872.957834:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c376a 00000020:00000080:0.0:1787856872.957843:0:15185:0:(genops.c:885:class_export_put()) final put ffff9066007b1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787856872.957852:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787856872.957860:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787856872.957866:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787856872.957869:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9065ea7b4d70) has no exports 00000020:00000080:0.0:1787856872.957877:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3763 00000020:00000080:0.0:1787856872.957880:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065fd621800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787856872.958325:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c688e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787856872.961910:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c808b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787856872.961928:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c808a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787856872.961937:0:38:0:(genops.c:885:class_export_put()) final put ffff906601919000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787856872.961939:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff906601919000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787856872.961944:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787856872.962046:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c5e7d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787856872.962052:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c5e7f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787856872.962056:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c5e78000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787856872.962062:0:38:0:(genops.c:885:class_export_put()) final put ffff9064c5e7a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787856872.962064:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c5e7a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787856872.962067:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787856872.962095:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9066007b1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787856872.962100:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fd621800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787856872.973586:0:15185:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787856872.973596:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787856872.973601:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787856872.973610:0:15185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787856872.973682:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856872.973696:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787856872.973724:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856872.973745:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787856872.973750:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065d03c9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787856872.973755:0:15185:0:(genops.c:844:class_export_destroy()) destroying export ffff9065d03c9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787856872.973767:0:15185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787856872.973869:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c35cd 00000020:00000080:1.0:1787856872.973875:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c46ec000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787856872.973881:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787856872.973885:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856872.973890:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787856872.973893:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9065c4f399d0) has no exports 00000020:00000080:1.0:1787856872.973911:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856872.973915:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787856872.973919:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c35d4 00000020:00000080:1.0:1787856872.973922:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c46ed800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787856872.973930:0:15185:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065d3be8000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787856872.973934:0:15185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065d3be8000 3 00000020:01000004:1.0:1787856872.973937:0:15185:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9065d3be8000 from lustre-MDT0000 00000020:00000080:1.0:1787856872.973954:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856872.973957:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787856872.973970:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c6618000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787856872.973972:0:15185:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c6618000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787856872.973979:0:15185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787856872.974009:0:15185:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787856872.974013:0:15185:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787856872.974015:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787856872.974018:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856872.974020:0:15185:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787856872.974026:0:15185:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9065ca4b5800 c911024a-9030-4ea8-a782-9255ee9580a7 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787856872.974031:0:15185:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9065c4f3b3a0) has exports, disconnecting them 00000020:00080000:1.0:1787856872.974036:0:15185:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9065ca4b5800), last request at 1787856595 00000020:00000080:1.0:1787856872.974049:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3572 00000020:00010000:1.0:1787856872.974053:0:15185:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9065ca4b5800: total 2 00000100:00080000:1.0:1787856872.974062:0:15185:0:(import.c:65:import_set_state_nolock()) ffff9065ca4b4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787856872.974085:0:15185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9065ca4b5800): rc 0 00000020:00080000:1.0:1787856872.974089:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9065c4f3b3a0) has no exports 00000100:00100000:1.0:1787856872.974144:0:6491:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9065eb763000:6491] 2 exiting: rc = 0 00000020:00010000:1.0:1787856872.974254:0:7903:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9065ca4b5800: total 2 00010000:00010000:1.0:1787856872.974281:0:7903:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9065ca4b5800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787856872.974310:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9066007ba600/0xc25410d92a3c3d13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3d0c expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974325:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076ba00/0xc25410d92a3c3d21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3d1a expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974466:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37c000/0xc25410d92a3c3a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3a88 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974486:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076b800/0xc25410d92a3c3af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3aea expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974497:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37c200/0xc25410d92a3c3a81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3a7a expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974507:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5fe200/0xc25410d92a3c3993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c398c expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974520:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37c400/0xc25410d92a3c3a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3a96 expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974528:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065cd37ca00/0xc25410d92a3c3aab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3aa4 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974537:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ffa00/0xc25410d92a3c3ab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3ab2 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974557:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274b400/0xc25410d92a3c366e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3667 expref: 5 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974568:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ff600/0xc25410d92a3c3ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3ac0 expref: 4 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974581:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c367c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3675 expref: 3 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974592:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660076ac00/0xc25410d92a3c3d05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc25410d92a3c3cfe expref: 2 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856872.974604:0:7903:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9065ca4b5800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787856872.974619:0:7903:0:(genops.c:885:class_export_put()) final put ffff9065ca4b5800/c911024a-9030-4ea8-a782-9255ee9580a7 00010000:00010000:1.0:1787856872.974626:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856872.974628:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856872.974630:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856872.974667:0:6488:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9065f5cb4e00:6488] 0 exiting: rc = 1 00000020:00000080:3.0:1787856872.974771:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065fd627000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787856872.974778:0:38:0:(genops.c:885:class_export_put()) final put ffff9065fd623000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787856872.974781:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fd623000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787856872.974791:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787856872.974849:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c46ec000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787856872.974853:0:38:0:(genops.c:885:class_export_put()) final put ffff9065c46ef000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787856872.974855:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c46ef000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787856872.974858:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787856872.974884:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c46ed800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787856872.974889:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065ca4b5800/c911024a-9030-4ea8-a782-9255ee9580a7 for MGS 00000020:00000080:3.0:1787856872.974919:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065ca4b4000 for MGS 00000100:00100000:3.0:1787856872.974984:0:6490:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9065ca0b4400:6490] 1 exiting: rc = 0 00000100:00100000:1.0:1787856872.975296:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975304:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975310:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975316:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975322:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975328:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975333:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975338:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975516:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975522:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975527:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975533:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975539:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975551:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975557:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975563:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975568:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975624:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975630:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975636:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975642:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975648:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975653:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975659:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975665:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975767:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975776:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975782:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975789:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975795:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975800:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975806:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975813:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975818:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975823:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975829:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975834:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975840:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975846:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975851:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975856:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975862:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975867:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975873:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975878:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975883:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975888:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975893:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975905:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975911:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975916:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975921:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975926:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975932:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975937:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975942:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975948:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975952:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.975957:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.976293:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.976299:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.976305:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.976310:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856872.976316:0:15185:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1787856872.994350:0:15185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9064c1c28ea0 - data ffff9065c9795af8/ffff9064c8062c00 00000020:01000000:3.0:1787856872.994481:0:15185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9065c2e05060 - data ffff9065c2294288/ffff9065f5cb9400 00000020:00000080:3.0:1787856872.994947:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3556 00000020:00000080:3.0:1787856872.994957:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c8d86800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787856872.994976:0:15185:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065d3be8000 from MGS, refs=2 00000020:01000004:3.0:1787856872.994979:0:15185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065d3be8000 2 00000020:01000004:3.0:1787856872.994982:0:15185:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9065d3be8000 from MGS 00000020:00000080:3.0:1787856872.995005:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787856872.995011:0:15185:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787856872.995014:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c8d87000/MGS 00000020:00000080:3.0:1787856872.995016:0:15185:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c8d87000/MGS for MGS 00000020:01000000:3.0:1787856872.995023:0:15185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787856872.995088:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787856872.995092:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787856872.995097:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787856872.995104:0:15185:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9065f71fe800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787856872.995110:0:15185:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9065fbf90000) has exports, disconnecting them 00000020:00080000:3.0:1787856872.995114:0:15185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9065f71fe800), last request at 1787856596 00000020:00000080:3.0:1787856872.995118:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3621 00000020:00080000:3.0:1787856872.995128:0:15185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9065f71fe800): rc 0 00000020:00000080:3.0:1787856872.995133:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065f71fe800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787856872.995766:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c8d86800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787856872.995780:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065f71fe800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787856873.025422:0:15185:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787856873.025433:0:15185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787856873.025437:0:15185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787856873.025444:0:15185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787856873.025476:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065f71f9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787856873.025681:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856873.025689:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787856873.025694:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065f71fa000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787856873.025698:0:15185:0:(genops.c:844:class_export_destroy()) destroying export ffff9065f71fa000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787856873.025708:0:15185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787856873.025791:0:15185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065d3be8000 1 00000020:00000080:1.0:1787856873.025797:0:15185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3548 00000020:00000080:1.0:1787856873.025804:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065c8d81800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787856873.025813:0:15185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787856873.025831:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c8d81800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787856873.025841:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856873.025845:0:15185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787856873.025849:0:15185:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9065fbf94d70) has no exports 00000020:00000080:1.0:1787856873.323822:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856873.323836:0:15185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787856873.323841:0:15185:0:(genops.c:885:class_export_put()) final put ffff9065d045f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787856873.323846:0:15185:0:(genops.c:844:class_export_destroy()) destroying export ffff9065d045f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787856873.323852:0:15185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787856873.324471:0:15185:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9065d045c000 00000020:02000400:1.0:1787856873.324537:0:15185:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787856873.386684:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856874.458967:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856875.473834:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856875.857734:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436390016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856875.857807:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856875.857884:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436390016 00000100:00100000:3.0:1787856875.857890:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436390016 00000100:00100000:3.0:1787856875.857947:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787856875.857956:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436390016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787856875.857983:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787856875.858032:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436390016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856875.858037:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1787856875.858053:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856875.858078:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436390016:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787856875.858237:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856875.858240:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787856875.858243:0:38:0:(import.c:65:import_set_state_nolock()) ffff9065c46e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856875.858247:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 404 00000100:00080000:1.0:1787856875.858251:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787856875.858255:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9065c46e8000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856875.858276:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c6b5c000 x1874703436390272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856875.858291:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856875.858295:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787856875.858296:0:38:0:(import.c:65:import_set_state_nolock()) ffff90660050d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856875.858299:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 404 00000100:00080000:1.0:1787856875.858302:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787856875.858305:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90660050d000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856875.858317:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601989a40 x1874703436390400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856875.858348:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856875.858351:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787856875.858353:0:38:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856875.858357:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 404 00000100:00080000:1.0:1787856875.858359:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787856875.858362:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9064c6898800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856875.858377:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9065d9deb480 x1874703436390528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856875.858408:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856875.858411:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787856875.858413:0:38:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856875.858417:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 404 00000100:00080000:1.0:1787856875.858419:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787856875.858422:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9064c723f800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856875.858432:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9065d9de9680 x1874703436390912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856875.858458:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436390144:0@lo:400:kworker.0 00000400:00000100:1.0:1787856875.858478:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874703436390144 offset 0 length 224: 4 00000100:00100000:1.0:1787856875.858496:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856875.858499:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436391040:0@lo:400:kworker.0 00000100:00100000:1.0:1787856875.858516:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856875.858533:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436390272:0@lo:38:kworker.0 00000100:00100000:1.0:1787856875.858550:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856875.858573:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601989a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874703436390400:0@lo:38:kworker.0 00000100:00100000:1.0:1787856875.858594:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856875.858610:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436390528:0@lo:38:kworker.0 00000100:00100000:1.0:1787856875.858629:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856875.858646:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436390912:0@lo:38:kworker.0 00000100:00100000:1.0:1787856875.858665:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856875.858692:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9dead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436390656:0@lo:400:kworker.0 00000100:00100000:1.0:1787856875.858727:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856875.858747:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856875.858752:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436390784:0@lo:400:kworker.0 00000100:00100000:1.0:1787856875.858773:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856875.858803:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436391040 00000100:00100000:1.0:1787856875.858807:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436391040 00000100:00100000:1.0:1787856875.858838:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436390400 00000100:00100000:1.0:1787856875.858840:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436390400 00000100:00100000:1.0:1787856875.858848:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436390528 00000100:00100000:1.0:1787856875.858849:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436390528 00000100:00100000:1.0:1787856875.858856:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436390912 00000100:00100000:1.0:1787856875.858857:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436390912 00000100:00100000:1.0:1787856875.858864:0:8909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436390656 00000100:00100000:1.0:1787856875.858866:0:8909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436390656 00000100:00100000:1.0:1787856875.858882:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1787856875.858889:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9dea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436391040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856875.858926:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9dea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874703436391040:12345-0@lo:400:kworker.0 Request processed in 37us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856875.858947:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1787856875.858962:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787856875.858969:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436390656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856875.859011:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436390656:12345-0@lo:400:kworker.0 Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856875.859017:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787856875.859031:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787856875.859035:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1874703436390400:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787856875.859050:0:8909:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787856875.859082:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1874703436390400:12345-0@lo:38:kworker.0 Request processed in 46us (487us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787856875.859088:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787856875.859098:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787856875.859102:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9debc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1874703436390528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787856875.859111:0:8909:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787856875.859132:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9debc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1874703436390528:12345-0@lo:38:kworker.0 Request processed in 29us (502us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787856875.859136:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787856875.859143:0:8909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787856875.859146:0:8909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1874703436390912:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787856875.859151:0:8909:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787856875.859163:0:8909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1874703436390912:12345-0@lo:38:kworker.0 Request processed in 17us (498us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787856875.859166:0:8909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787856875.859188:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436390784 00000100:00100000:1.0:1787856875.859190:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436390784 00000100:00100000:1.0:1787856875.859208:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787856875.859212:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436390784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856875.859256:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436390784:12345-0@lo:400:kworker.0 Request processed in 44us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856875.859261:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787856875.859272:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856875.859274:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787856875.859290:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9065d9de83c0 x1874703436391040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856875.859300:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436391040:0@lo:400:kworker.0 00000100:00100000:1.0:1787856875.859324:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436390784:0@lo:400:kworker.0 00010000:00080000:1.0:1787856875.859344:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9065d9dead00 x1874703436390656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856875.859352:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9dead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436390656:0@lo:400:kworker.0 00000100:00080000:1.0:1787856875.859379:0:3622:0:(import.c:65:import_set_state_nolock()) ffff90660050d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856875.859384:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856875.859387:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601989a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874703436390400:0@lo:38:kworker.0 00000100:00080000:1.0:1787856875.859395:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856875.859397:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856875.859400:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436390528:0@lo:38:kworker.0 00000100:00080000:1.0:1787856875.859406:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856875.859409:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856875.859411:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9de9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436390912:0@lo:38:kworker.0 00000100:00100000:3.0:1787856875.859957:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436390272 00000100:00100000:3.0:1787856875.859963:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436390272 00000100:00100000:3.0:1787856875.859995:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787856875.860000:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9de9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436390272:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787856875.860012:0:6501:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787856875.860060:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9de9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436390272:12345-0@lo:38:kworker.0 Request processed in 58us (1509us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787856875.860066:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787856875.860090:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856875.860099:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436391168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856875.860121:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856875.860269:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436391168 00000100:00100000:2.0:1787856875.860275:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436391168 00000100:00100000:2.0:1787856875.860309:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787856875.860317:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436391168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787856875.860345:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787856875.860381:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436391168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856875.860388:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1787856875.860414:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065c46e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856875.860419:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787856875.860422:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436390272:0@lo:38:kworker.0 00000100:00100000:3.0:1787856875.860920:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436391168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787856876.512414:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856877.530451:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856878.546119:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856879.571659:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787856879.597114:0:15386:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787856879.648382:0:15386:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787856879.648494:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.648509:0:15386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.648527:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.648535:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.648573:0:15386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787856879.648580:0:15386:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787856879.648609:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787856879.648613:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787856879.648619:0:15386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787856879.648624:0:15386:0:(import.c:65:import_set_state_nolock()) ffff90660050d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787856879.648630:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787856879.648631:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787856879.648634:0:15386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787856879.649540:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649554:0:15386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649561:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649567:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649584:0:15386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787856879.649589:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649596:0:15386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649615:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649621:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649639:0:15386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787856879.649647:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649653:0:15386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649659:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649665:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649671:0:15386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787856879.649676:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649681:0:15386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649686:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649702:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856879.649709:0:15386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:2.0:1787856879.649712:0:15386:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1787856879.649735:0:15386:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787856879.649738:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1787856879.649743:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787856879.649748:0:15386:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787856879.649755:0:15386:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9066018a3800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787856879.649761:0:15386:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9065fe846000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787856879.649765:0:15386:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9065e9fd33a0) has exports, disconnecting them 00000020:00080000:2.0:1787856879.649770:0:15386:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9066018a3800), last request at 1787856875 00000020:00000080:2.0:1787856879.649776:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3954 00000100:00080000:2.0:1787856879.649796:0:15386:0:(import.c:65:import_set_state_nolock()) ffff9066018a2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787856879.649846:0:15386:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9066018a3800): rc 0 00000020:00000080:2.0:1787856879.649848:0:15386:0:(genops.c:885:class_export_put()) final put ffff9066018a3800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1787856879.649859:0:15386:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9065fe846000), last request at 1787856875 00000020:00000080:2.0:1787856879.649862:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c386d 00000100:00080000:2.0:1787856879.649867:0:15386:0:(import.c:65:import_set_state_nolock()) ffff9065fe846800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787856879.649877:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9066018a3800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787856879.649919:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9066018a2000 for lustre-MDT0001 00000020:00080000:2.0:1787856879.649931:0:15386:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9065fe846000): rc 0 00000020:00000080:2.0:1787856879.649933:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065fe846000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1787856879.649943:0:15386:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffae99c1c77ae0 00000020:00000080:2.0:1787856879.649953:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe846000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787856879.649970:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065fe846800 for lustre-MDT0001 00000100:00080000:2.0:1787856879.649993:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787856879.650002:0:15386:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9064c8241680 x1874703436387968/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787856883 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856879.650014:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1787856879.650804:0:15386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787856879.650810:0:15386:0:(import.c:65:import_set_state_nolock()) ffff9065c46e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787856879.650967:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787856879.650970:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:2.0:1787856879.650981:0:15386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787856879.651037:0:15386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787856879.651059:0:15386:0:(import.c:65:import_set_state_nolock()) ffff9066018a1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787856879.651074:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787856879.651077:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1787856879.651083:0:15386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787856879.651161:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c81bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436391296:0@lo:9:umount.0 00000100:00100000:2.0:1787856879.651253:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787856879.651680:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787856879.651689:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651699:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274a200 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856879.651703:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651712:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856879.651736:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856879.651743:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787856879.651745:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787856879.651748:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787856879.651776:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651782:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856879.651801:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651809:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274a200/0xc25410d92a3c3ab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ab9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651820:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787856879.651823:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651829:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274b800 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856879.651831:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651837:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856879.651842:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856879.651856:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787856879.651858:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1787856879.651860:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1787856879.651873:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651878:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856879.651884:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651890:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274b800/0xc25410d92a3c3ac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651900:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787856879.651903:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651908:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffe00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856879.651910:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651916:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856879.651922:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856879.651927:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787856879.651929:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787856879.651930:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787856879.651950:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651955:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856879.651967:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651973:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5ffe00/0xc25410d92a3c398c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3993 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651985:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787856879.651988:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.651993:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856879.651996:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652002:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856879.652008:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856879.652013:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787856879.652015:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787856879.652016:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787856879.652028:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652033:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856879.652038:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652050:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601938600/0xc25410d92a3c3d1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c3d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652059:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856879.652062:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652068:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff400 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856879.652070:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652077:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856879.652082:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856879.652088:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787856879.652090:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787856879.652092:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787856879.652104:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652109:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856879.652114:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652120:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff400/0xc25410d92a3c3675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc25410d92a3c367c expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856879.652141:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856879.652144:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856879.652146:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856879.652175:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436391296 00000100:00100000:3.0:1787856879.652182:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436391296 00000100:00100000:3.0:1787856879.652267:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787856879.652277:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874703436391296:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787856879.652312:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c38c1 00000100:00080000:3.0:1787856879.652320:0:8407:0:(import.c:65:import_set_state_nolock()) ffff9064c7041800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787856879.652362:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787856879.652512:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3622:x1874703436391296:12345-0@lo:9:umount.0 Request processed in 236us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856879.652520:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787856879.652733:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436391424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856879.652769:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856879.652807:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436391552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856879.652831:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856879.652856:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436391808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856879.652878:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787856879.652898:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856879.652918:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436391424 00000100:00100000:3.0:1787856879.652922:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436391424 00000100:00100000:3.0:1787856879.652944:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436391552 00000100:00100000:3.0:1787856879.652947:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436391552 00000100:00100000:3.0:1787856879.652957:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436391808 00000100:00100000:3.0:1787856879.652960:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436391808 00000100:00100000:3.0:1787856879.652983:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787856879.652988:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3625:x1874703436391424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787856879.652993:0:6483:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787856879 with bad export cookie 14002835666304251250 00010000:00010000:0.0:1787856879.653629:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856879.653657:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856879.653664:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3626:x1874703436391552:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787856879.653670:0:13166:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787856879 with bad export cookie 14002835666304251250 00000100:00100000:0.0:1787856879.653727:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3626:x1874703436391552:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (894us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787856879.653734:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856879.653750:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856879.653754:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3624:x1874703436391808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787856879.653758:0:13166:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787856879 with bad export cookie 14002835666304251250 00000100:00100000:0.0:1787856879.653789:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3624:x1874703436391808:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (910us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787856879.653795:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787856879.655249:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856879.655352:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856879.655380:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436391680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856879.655439:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856879.655484:0:13166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436391680 00000100:00100000:1.0:1787856879.655491:0:13166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436391680 00000100:00100000:1.0:1787856879.655531:0:13166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787856879.655537:0:13166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3623:x1874703436391680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787856879.655543:0:13166:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787856879 with bad export cookie 14002835666304251250 00000100:00100000:1.0:1787856879.655583:0:13166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3623:x1874703436391680:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (143us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787856879.655589:0:13166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787856879.655625:0:15386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787856879.655647:0:15386:0:(import.c:65:import_set_state_nolock()) ffff90660191a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787856879.655679:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9065e9fd33a0) has no exports 00000100:00080000:2.0:1787856879.660074:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066018a1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787856879.660093:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787856879.660096:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787856879.660102:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c81bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436391296:0@lo:9:umount.0 00000100:00100000:2.0:1787856879.660133:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436392064:0@lo:9:umount.0 00000100:00100000:2.0:1787856879.660196:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856879.660253:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436392064 00000100:00100000:2.0:1787856879.660259:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436392064 00000100:00100000:2.0:1787856879.660319:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787856879.660329:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c81bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874703436392064:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787856879.660356:0:10490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c39bd 00000100:00080000:2.0:1787856879.660374:0:10490:0:(import.c:65:import_set_state_nolock()) ffff90660191e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787856879.660413:0:10490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787856879.662481:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c81bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3622:x1874703436392064:12345-0@lo:9:umount.0 Request processed in 2146us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856879.662495:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787856879.662628:0:3622:0:(import.c:65:import_set_state_nolock()) ffff90660191a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787856879.662690:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787856879.681439:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787856879.681462:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436392064:0@lo:9:umount.0 00000100:00080000:2.0:1787856879.683523:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856879.683586:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436391936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856879.683655:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787856879.683833:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787856879.683839:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9065ca4b6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787856879.683843:0:3626:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1787856879.687698:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3625:x1874703436391424:12345-0@lo:103:ldlm_bl.0 Request processed in 34703us (34923us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787856879.687712:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787856879.687770:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787856879.687861:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1787856879.701566:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436391936 00000100:00100000:0.0:1787856879.701581:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436391936 00000100:00100000:0.0:1787856879.701634:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787856879.701642:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3625:x1874703436391936:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787856879.701650:0:6482:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787856879 with bad export cookie 14002835666304251250 00000100:00100000:0.0:1787856879.701741:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3625:x1874703436391936:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (18084us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787856879.701748:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787856879.701776:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787856879.730554:0:3626:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787856879.730561:0:3626:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787856879.730570:0:3626:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c6b5c780 x1874703436390144/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787856891 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856879.730585:0:3626:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff906601a3f0c0 x1874703436391424/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787856895 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856879.730595:0:3626:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff906601a3da40 x1874703436391552/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787856895 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856879.730603:0:3626:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff906601a3cb40 x1874703436391808/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787856895 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856879.730634:0:3626:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff906601a3cf00 x1874703436391680/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787856895 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856879.730642:0:3626:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff906601a3ed00 x1874703436391936/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787856895 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787856879.730650:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787856879.730653:0:3626:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787856879.730655:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787856879.735531:0:3625:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9065ca4b6000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787856879.735566:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436391936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856879.735598:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c911024a-9030-4ea8-a782-9255ee9580a7:3625:1874703436391424:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787856879.736054:0:3624:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9065ca4b6000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787856879.736071:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436390144:0@lo:400:kworker.0 00000100:00100000:2.0:1787856879.738448:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c911024a-9030-4ea8-a782-9255ee9580a7:3624:1874703436391808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856879.738601:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c911024a-9030-4ea8-a782-9255ee9580a7:3623:1874703436391680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856879.738609:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436387968:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787856879.739757:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9065ca4b6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856879.739767:0:3626:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 129 00000100:00080000:1.0:1787856879.739777:0:3626:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9065ca4b6000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856879.740161:0:3626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83f83c0 x1874703436392192/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856879.740200:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c911024a-9030-4ea8-a782-9255ee9580a7:3626:1874703436391552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856879.740501:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c911024a-9030-4ea8-a782-9255ee9580a7:3622:1874703436392192:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1787856879.740558:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874703436392192 offset 0 length 520: 4 00000020:00080000:1.0:1787856879.753817:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9065e9fd33a0) has no exports 00000020:01000000:2.0:1787856879.884476:0:15386:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9064c79af9c0 - data ffff9065eb32a5e8/ffff9064c80cb000 00000020:01000000:2.0:1787856879.885007:0:15386:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9065eb4c66c0 - data ffff9065eb1d2e58/ffff906600459800 00000001:00000004:3.0:1787856879.913547:0:15386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1787856880.044110:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787856880.044119:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1787856880.044483:0:15386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787856880.068409:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787856880.068418:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:3.0:1787856880.068440:0:15386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787856880.068443:0:15386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787856880.070208:0:8907:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787856880.070241:0:8907:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1787856880.070274:0:8907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787856880.071522:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787856880.071528:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1787856880.071548:0:15386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787856880.071551:0:15386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787856880.075096:0:9830:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787856880.075105:0:9830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1787856880.075123:0:9830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787856880.082441:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3698 00000020:00000080:3.0:1787856880.082455:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065e85d2000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787856880.082926:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065e85d2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787856880.090954:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c36ad 00000020:00000080:3.0:1787856880.090969:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065c661d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787856880.090989:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787856880.090995:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787856880.091004:0:15386:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787856880.091008:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9065e9fd19d0) has no exports 00000004:01000000:3.0:1787856880.091181:0:15386:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787856880.091201:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c39b6 00000020:00000080:3.0:1787856880.091206:0:15386:0:(genops.c:885:class_export_put()) final put ffff9064c723c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787856880.091210:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787856880.091214:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787856880.091246:0:15386:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787856880.091248:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9065fe89cd70) has no exports 00000020:00000080:3.0:1787856880.091254:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c39af 00000020:00000080:3.0:1787856880.091258:0:15386:0:(genops.c:885:class_export_put()) final put ffff90660191b800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787856880.091608:0:15386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787856880.091613:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787856880.091617:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787856880.091622:0:15386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787856880.091625:0:15386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787856880.091654:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787856880.091661:0:15386:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787856880.091666:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c38ba 00000020:00000080:3.0:1787856880.091670:0:15386:0:(genops.c:885:class_export_put()) final put ffff9066018a7800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787856880.091674:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787856880.091677:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787856880.091681:0:15386:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787856880.091683:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9065fe898000) has no exports 00000020:00000080:3.0:1787856880.091687:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c38b3 00000020:00000080:3.0:1787856880.091690:0:15386:0:(genops.c:885:class_export_put()) final put ffff9066018a4800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787856880.092006:0:15386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787856880.092009:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787856880.092011:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:3.0:1787856880.092015:0:15386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787856880.092017:0:15386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787856880.092037:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787856880.092043:0:15386:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787856880.092052:0:15386:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787856880.092058:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c36d0 00000020:00000080:3.0:1787856880.092069:0:15386:0:(genops.c:885:class_export_put()) final put ffff90660043b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787856880.092074:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787856880.092076:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787856880.092080:0:15386:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787856880.092082:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9065fe7119d0) has no exports 00000020:00000080:3.0:1787856880.092085:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c36c9 00000020:00000080:3.0:1787856880.092087:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065c46eb000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787856880.092953:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c661d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1787856880.092970:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c723c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787856880.092975:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90660191b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787856880.092980:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90660191a000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787856880.092986:0:38:0:(genops.c:885:class_export_put()) final put ffff90660191d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787856880.092988:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90660191d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787856880.092992:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787856880.093073:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9066018a7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787856880.093077:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9066018a4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787856880.093081:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9066018a1800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787856880.093085:0:38:0:(genops.c:885:class_export_put()) final put ffff9065c46e9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787856880.093087:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c46e9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787856880.093090:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787856880.093115:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90660043b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787856880.093119:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c46eb000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787856880.099341:0:15386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787856880.099352:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787856880.099357:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787856880.099366:0:15386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787856880.099427:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856880.099439:0:15386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787856880.099473:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856880.099478:0:15386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787856880.099483:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065e85da000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787856880.099488:0:15386:0:(genops.c:844:class_export_destroy()) destroying export ffff9065e85da000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787856880.099507:0:15386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787856880.099693:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c36b4 00000020:00000080:2.0:1787856880.099701:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065c661e800/lustre-MDD0001_UUID 00000020:01000000:2.0:1787856880.099707:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787856880.099711:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787856880.099716:0:15386:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787856880.099719:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9065e9fd4d70) has no exports 00000020:00000080:2.0:1787856880.099740:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856880.099743:0:15386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787856880.099748:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c36bb 00000020:00000080:2.0:1787856880.099751:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065c6619000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787856880.099759:0:15386:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065f7199800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787856880.099762:0:15386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065f7199800 2 00000020:01000004:2.0:1787856880.099765:0:15386:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9065f7199800 from lustre-MDT0001 00000020:00000080:2.0:1787856880.099795:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856880.099799:0:15386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787856880.099802:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065e85d3800/lustre-MDT0001_UUID 00000020:00000080:2.0:1787856880.099804:0:15386:0:(genops.c:844:class_export_destroy()) destroying export ffff9065e85d3800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787856880.099811:0:15386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787856880.099839:0:15386:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787856880.099843:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787856880.099846:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787856880.099849:0:15386:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787856880.099856:0:15386:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90660050f000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787856880.099862:0:15386:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9065fbf919d0) has exports, disconnecting them 00000020:00080000:2.0:1787856880.099867:0:15386:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90660050f000), last request at 1787856616 00000020:00000080:2.0:1787856880.099871:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c370f 00000020:00080000:2.0:1787856880.099885:0:15386:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90660050f000): rc 0 00000020:00000080:2.0:1787856880.099888:0:15386:0:(genops.c:885:class_export_put()) final put ffff90660050f000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787856880.100627:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065c46e8000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787856880.100638:0:38:0:(genops.c:885:class_export_put()) final put ffff9065e85df000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787856880.100641:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065e85df000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787856880.100650:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787856880.100753:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c661e800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787856880.100757:0:38:0:(genops.c:885:class_export_put()) final put ffff9065d03cc800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787856880.100759:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065d03cc800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787856880.100773:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787856880.100985:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c6619000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787856880.100990:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90660050f000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787856880.347992:0:15386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787856880.348002:0:15386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787856880.348019:0:15386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787856880.348026:0:15386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787856880.349019:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856880.349030:0:15386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787856880.349036:0:15386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065f7199800 1 00000020:00000080:2.0:1787856880.349043:0:15386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c364b 00000020:00000080:2.0:1787856880.349051:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065f73ab000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787856880.349058:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787856880.349064:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787856880.349067:0:15386:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787856880.349071:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9065ea7b33a0) has no exports 00000020:00000080:1.0:1787856880.350905:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90660050d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787856880.350919:0:38:0:(genops.c:885:class_export_put()) final put ffff9065fe6d4000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787856880.350923:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe6d4000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787856880.350936:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787856880.351010:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9065f73ab000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:1.0:1787856880.596031:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787856880.672334:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856880.672349:0:15386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787856880.672356:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065f719b000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787856880.672360:0:15386:0:(genops.c:844:class_export_destroy()) destroying export ffff9065f719b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787856880.672371:0:15386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787856880.672515:0:15386:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9065f7198800 00000020:01000000:1.0:1787856880.672539:0:15386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787856880.672543:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856880.672548:0:15386:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787856880.672551:0:15386:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9065ea7b0000) has no exports 00000100:00100000:1.0:1787856880.672644:0:6498:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9065ca0b4a00:6498] 2 exiting: rc = 0 00000100:00100000:1.0:1787856880.672762:0:6496:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9065c64ca800:6496] 0 exiting: rc = 1 00000100:00100000:1.0:1787856880.672831:0:9124:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff90660067e000:9124] 4 exiting: rc = 0 00000100:00100000:1.0:1787856880.672911:0:6497:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9065ca0b5600:6497] 1 exiting: rc = 0 00000100:00100000:3.0:1787856880.673045:0:8909:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9064c5d6c600:8909] 3 exiting: rc = 0 00000100:00100000:1.0:1787856880.674382:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674393:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674401:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674406:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674414:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674421:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674429:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674451:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674459:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674465:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674471:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674479:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674485:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674492:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674499:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674979:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674987:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.674993:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675001:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675007:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675014:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675021:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675028:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675034:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675041:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675047:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675055:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675062:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675068:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675075:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.675081:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676398:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676409:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676416:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676447:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676455:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676462:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676468:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676474:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676481:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676488:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676494:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676981:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676988:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.676994:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677000:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677005:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677011:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677017:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677022:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677028:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677034:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677040:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677048:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677053:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677061:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677067:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677074:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677080:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677618:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677627:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677632:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677637:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787856880.677644:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787856880.692969:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9065ca0b4e00:6500] 1 exiting: rc = 0 00000100:00100000:1.0:1787856880.693357:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9065ca0b5800:6499] 0 exiting: rc = 1 00000100:00100000:2.0:1787856880.693495:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693514:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693521:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693526:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693532:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693539:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693545:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693550:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693556:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693562:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693567:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693572:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693578:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693583:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693589:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693594:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693598:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693603:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693608:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693614:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693619:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693623:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693628:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693646:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693651:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693656:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693662:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693667:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693672:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693678:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693683:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693688:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693693:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693697:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693703:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693707:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693712:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693718:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693723:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693728:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693733:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693738:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693744:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693749:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693754:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693759:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693764:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693769:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693774:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693781:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693787:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693792:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693797:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693802:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693807:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693813:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693818:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693823:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693837:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693841:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693846:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693850:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693855:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.693860:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787856880.694590:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9065eb43ca00:6501] 0 exiting: rc = 1 00000100:00100000:0.0:1787856880.694683:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9065eb43d000:6502] 1 exiting: rc = 0 00000100:00100000:2.0:1787856880.695782:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695794:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695801:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695807:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695812:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695817:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695823:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695848:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695857:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695862:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695869:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695876:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695881:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695897:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695906:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695913:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695920:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695925:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695932:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695953:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695960:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695967:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695973:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695979:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695984:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695991:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.695998:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696003:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696009:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696030:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696036:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696055:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696061:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696067:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696072:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696077:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696098:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696105:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696111:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696117:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696122:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696129:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696135:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696156:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696163:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696169:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696175:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696182:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696188:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696193:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696198:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696205:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696210:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696242:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696249:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696270:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696278:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696284:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696299:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696306:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696312:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696319:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696325:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.696337:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787856880.714209:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9065c5083c00:6504] 1 exiting: rc = 0 00000100:00100000:3.0:1787856880.714410:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9065c7adec00:6503] 0 exiting: rc = 1 00000100:00100000:2.0:1787856880.721154:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721165:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721171:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721176:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721183:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721188:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721193:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721199:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721205:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721210:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721357:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721367:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721372:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721379:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721385:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721390:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721395:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721399:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721404:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721410:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721415:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721420:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721425:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721431:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721436:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721441:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721446:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721451:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721457:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721463:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721468:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721472:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721477:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721482:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721488:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721512:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721517:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721523:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721529:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721534:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721539:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721545:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721551:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721556:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721561:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721566:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721571:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721576:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721582:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721587:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721593:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721598:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721603:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721609:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721614:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721619:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721625:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721629:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721636:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721641:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721646:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721652:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721657:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.721662:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.728043:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9065c7adf400:6506] 1 exiting: rc = 0 00000100:00100000:0.0:1787856880.728380:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9065c5082000:6505] 0 exiting: rc = 1 00000100:00100000:2.0:1787856880.728480:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728488:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728493:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728498:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728519:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728525:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728547:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728552:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728557:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728562:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728567:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728572:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728577:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728581:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728585:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728590:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728595:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728599:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728603:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728608:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728613:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728618:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728623:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728629:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728634:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728639:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728644:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728649:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728654:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728658:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728663:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728667:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728672:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728677:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728683:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728688:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728693:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728698:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728703:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728708:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728713:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728726:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728730:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728735:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728739:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728743:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728749:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728753:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728758:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728762:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728766:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728771:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728775:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728780:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728785:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728790:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728795:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728799:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728804:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728809:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728814:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728819:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728825:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.728830:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787856880.729542:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9065f5c51000:6508] 1 exiting: rc = 0 00000100:00100000:0.0:1787856880.729635:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9065c7adee00:6507] 0 exiting: rc = 1 00000100:00100000:2.0:1787856880.730206:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730239:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730247:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730252:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730259:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730264:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730270:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730275:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730280:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730294:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730301:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730306:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730325:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730330:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730335:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730340:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730346:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730351:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730356:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730361:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730366:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730372:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730377:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730382:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730387:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730392:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730396:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730401:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730406:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730411:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730415:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730420:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730424:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730429:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730436:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730440:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730446:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730450:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730455:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730459:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730464:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730469:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730473:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730478:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730483:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730488:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730493:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730518:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730523:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730528:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730533:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730538:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730543:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730547:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730553:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730557:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730562:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730567:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730572:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730577:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730582:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730587:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730593:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.730598:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856880.739163:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9065c9967c00:6509] 0 exiting: rc = 1 00000100:00100000:2.0:1787856880.740624:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9065c9967600:6511] 2 exiting: rc = 0 00000100:00100000:1.0:1787856880.740922:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9065c9966c00:6510] 1 exiting: rc = 0 00000100:00100000:3.0:1787856880.741027:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741035:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741041:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741046:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741052:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741057:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741063:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741073:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741078:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741096:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741104:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741109:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741115:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741121:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741126:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741131:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741136:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741141:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741159:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741166:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741171:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741176:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741181:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741187:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741205:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741210:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741245:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741253:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741257:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741262:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741268:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741274:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741279:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741295:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741302:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741308:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741313:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741319:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741325:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741330:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741336:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741342:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741363:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741370:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741376:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741381:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741387:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741392:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741397:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741403:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741410:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741415:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741421:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741426:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741432:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741437:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741442:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741450:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741455:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741469:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741474:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741479:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741485:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856880.741490:0:15386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787856880.754518:0:15386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856880.754534:0:15386:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787856880.754539:0:15386:0:(genops.c:885:class_export_put()) final put ffff9065c6619800/MDS_uuid 00000020:00000080:2.0:1787856880.754544:0:15386:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c6619800/MDS_uuid for MDS 00000020:01000000:2.0:1787856880.754550:0:15386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787856880.754740:0:15386:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:1.0:1787856880.977280:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856880.977302:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856880.977305:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856880.977309:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787856880.977313:0:38:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856880.977324:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 409 00000100:00080000:1.0:1787856880.977330:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787856880.977337:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9064c6898800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856880.977377:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83f8780 x1874703436392320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856880.977423:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856880.977426:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787856880.977428:0:38:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856880.977431:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 409 00000100:00080000:1.0:1787856880.977434:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787856880.977438:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9064c723f800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856880.977448:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83f8f00 x1874703436392576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787856880.977540:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436392320:0@lo:38:kworker.0 00000400:00000100:2.0:1787856880.977593:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436392320 offset 0 length 520: 4 00000100:00100000:2.0:1787856880.977638:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436392576:0@lo:38:kworker.0 00000400:00000100:2.0:1787856880.977656:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436392576 offset 0 length 520: 4 00000100:00100000:2.0:1787856880.977687:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436392704:0@lo:400:kworker.0 00000400:00000100:2.0:1787856880.977704:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436392704 offset 0 length 224: 4 00000100:00100000:3.0:1787856880.977820:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436392448:0@lo:400:kworker.0 00000400:00000100:3.0:1787856880.977843:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436392448 offset 0 length 224: 4 00010000:00010000:3.0:1787856881.619532:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856882.662790:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856883.667368:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856884.691045:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787856885.010544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787856885.010553:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856885.010556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787856885.010560:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856885.010631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787856885.010635:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787856885.010793:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787856885.010813:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436392832:0@lo:400:kworker.0 00000400:00000100:3.0:1787856885.010876:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436392832 offset 0 length 224: 4 00000100:00100000:3.0:1787856885.010948:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436392960:0@lo:400:kworker.0 00000400:00000100:3.0:1787856885.010969:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436392960 offset 0 length 224: 4 00000001:00100000:1.0:1787856885.088911:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787856885.088921:0:8402:0:(genops.c:885:class_export_put()) final put ffff9064c7047000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787856885.089082:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c7047000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787856885.089160:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c7041800 for lustre-OST0000 00000001:00100000:0.0:1787856885.089356:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787856885.089360:0:9490:0:(genops.c:885:class_export_put()) final put ffff90660191a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787856885.089379:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90660191a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787856885.089398:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90660191e000 for lustre-OST0001 00010000:00010000:3.0:1787856885.716699:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787856886.037340:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856886.037355:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856886.037359:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856886.037363:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856886.037441:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856886.037445:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787856886.037502:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856886.037529:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436393088:0@lo:400:kworker.0 00000400:00000100:1.0:1787856886.037602:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436393088 offset 0 length 224: 4 00000100:00100000:1.0:1787856886.037673:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856886.037695:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436393216:0@lo:400:kworker.0 00000400:00000100:1.0:1787856886.037734:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436393216 offset 0 length 224: 4 00000020:01000004:3.0:1787856886.610757:0:15587:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787856886.641280:0:15587:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787856886.641368:0:15587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856886.641389:0:15587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856886.641396:0:15587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856886.641403:0:15587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856886.641441:0:15587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787856886.641448:0:15587:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787856886.641467:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856886.641478:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856886.641488:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856886.641492:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787856886.641500:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1787856886.641504:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856886.641515:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856886.641518:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83f8780 x1874703436392320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787856900 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787856886.641529:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787856886.641537:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787856886.641540:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1787856886.641552:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1787856886.641562:0:7903:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9065ca4b6000 00010000:00010000:1.0:1787856886.641567:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856886.641575:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5ff000/0xc25410d92a3c3a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3a9d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856886.641591:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856886.641594:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856886.641597:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787856886.641603:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856886.641643:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00080000:1.0:1787856886.641649:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1787856886.641650:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436392320:0@lo:38:kworker.0 00000100:00080000:1.0:1787856886.641660:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856886.641738:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856886.641742:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787856886.641796:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436393344:0@lo:400:kworker.0 00000400:00000100:1.0:1787856886.642008:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436393344 offset 0 length 224: 4 00000100:00100000:1.0:1787856886.642119:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436393472:0@lo:400:kworker.0 00000400:00000100:1.0:1787856886.642142:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436393472 offset 0 length 224: 4 00000100:00080000:2.0:1787856886.643061:0:15587:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787856886.643073:0:15587:0:(import.c:65:import_set_state_nolock()) ffff9064c6898800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787856886.643084:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787856886.643088:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787856886.643093:0:15587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787856886.646380:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787856886.646852:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fa940 x1874703436392448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856896 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856886.646885:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c8243480 x1874703436392832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856901 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856886.646915:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fad00 x1874703436393088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856886.646929:0:15587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83f9e00 x1874703436393344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856886.647057:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787856886.647066:0:15587:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787856886.647100:0:15587:0:(import.c:65:import_set_state_nolock()) ffff9064c689f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787856886.647148:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874703436393600:0@lo:39:umount.0 00000400:00000100:2.0:1787856886.647263:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436393600 offset 0 length 224: 4 00000100:00100000:1.0:1787856886.647268:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436392448:0@lo:400:kworker.0 00000100:00100000:1.0:1787856886.647330:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436393088:0@lo:400:kworker.0 00000100:00100000:1.0:1787856886.647362:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436393344:0@lo:400:kworker.0 00000100:00100000:0.0:1787856886.647645:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874703436392832:0@lo:400:kworker.0 00010000:00010000:2.0:1787856886.737918:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856887.762268:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856888.785612:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856889.745444:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856879/real 1787856879] req@ffff9064c83f83c0 x1874703436392192/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787856889 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856889.745488:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c83f83c0 x1874703436392192/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787856889 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787856889.745512:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065ca4b6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856889.745545:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787856889.745550:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c911024a-9030-4ea8-a782-9255ee9580a7:3622:1874703436392192:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1787856889.745872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856889.745880:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787856889.745884:0:8:0:(import.c:65:import_set_state_nolock()) ffff9065ca4b6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856889.745890:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 413 00000100:00080000:1.0:1787856889.745898:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.106@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787856889.745907:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9065ca4b6000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856889.746026:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83f9e00 x1874703436393728/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856889.746053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856889.746058:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787856889.746147:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856889.746311:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c911024a-9030-4ea8-a782-9255ee9580a7:3622:1874703436393728:0@lo:250:kworker.0 00000400:00000100:2.0:1787856889.746378:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874703436393728 offset 0 length 520: 4 00000100:00100000:0.0:1787856889.746419:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436393856:0@lo:400:kworker.0 00000400:00000100:0.0:1787856889.746457:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436393856 offset 0 length 224: 4 00010000:00010000:2.0:1787856889.810391:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856890.833902:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856891.858558:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856892.885089:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856893.905865:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787856894.803643:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856894.803653:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856894.803673:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856894.803677:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787856894.803791:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856894.805126:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436393984:0@lo:400:kworker.0 00000400:00000100:2.0:1787856894.805197:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436393984 offset 0 length 224: 4 00010000:00010000:0.0:1787856894.932213:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856895.953752:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1787856896.337413:0:3623:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856880/real 1787856880] req@ffff9064c83f9680 x1874703436392704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787856896 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856896.381311:0:3623:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9064c83f9680 x1874703436392704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787856896 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787856896.381328:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9065c46ee000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787856896.381332:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787856896.388273:0:3623:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1787856896.388326:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436392704:0@lo:400:kworker.0 00000100:00080000:3.0:1787856896.389335:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787856896.389342:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856896.389345:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787856896.389348:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856896.389350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787856896.389353:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787856896.389357:0:8:0:(import.c:65:import_set_state_nolock()) ffff9065c46ee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856896.389363:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 192 00000100:00080000:3.0:1787856896.389391:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9065c46ee000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856896.389435:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3d2c0 x1874703436394112/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787856896.389535:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874703436394112:0@lo:38:kworker.0 00000400:00000100:2.0:1787856896.389592:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436394112 offset 0 length 520: 4 00010000:00010000:3.0:1787856896.977379:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856897.425456:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856886/real 1787856886] req@ffff9064c826e1c0 x1874703436393600/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787856896 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856897.425491:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c826e1c0 x1874703436393600/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787856896 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787856897.425510:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c689f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787856897.425535:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874703436393600:0@lo:39:umount.0 00000100:00080000:3.0:1787856897.425762:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787856897.425768:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787856897.425773:0:15587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787856897.429447:0:15587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856897.429467:0:15587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856897.429476:0:15587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856897.429483:0:15587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856897.429516:0:15587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856897.429525:0:15587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856897.429532:0:15587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856897.429540:0:15587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856897.429546:0:15587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.429567:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856897.429585:0:15587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787856897.429592:0:15587:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787856897.429621:0:15587:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787856897.429625:0:15587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787856897.429630:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787856897.429636:0:15587:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787856897.429640:0:15587:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9064c5d9b3a0) has no exports 00000020:00080000:3.0:1787856897.429663:0:15587:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9064c5d9b3a0) has no exports 00010000:00010000:0.0:1787856897.429783:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.429793:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274b600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787856897.429797:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.429814:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856897.429821:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856897.429827:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787856897.429830:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787856897.429832:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787856897.429847:0:7903:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9065ca4b6000 00010000:00010000:0.0:1787856897.429851:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.429858:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065d274b600/0xc25410d92a3c3aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3aab expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.431334:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856897.431344:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.431353:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939200 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787856897.431357:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.431365:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856897.431372:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856897.431395:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787856897.431398:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787856897.431400:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787856897.431411:0:7903:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9065ca4b6000 00010000:00010000:0.0:1787856897.431414:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.431420:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601939200/0xc25410d92a3c3d0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3d13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856897.431429:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856897.431431:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856897.431434:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856897.434456:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787856897.436571:0:15587:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9064c1c28120 - data ffff9065c9795870/ffff9064c8062000 00000020:01000000:3.0:1787856897.436717:0:15587:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9064c6acdd20 - data ffff9065eb1d4ca8/ffff9066007eb800 00100000:10000000:3.0:1787856897.446389:0:15587:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787856897.470900:0:15587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c37f6 00000020:00000080:0.0:1787856897.470912:0:15587:0:(genops.c:885:class_export_put()) final put ffff9064c5d31000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787856897.470936:0:15587:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065fe6d5000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787856897.470940:0:15587:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe6d5000 2 00000020:01000004:0.0:1787856897.470943:0:15587:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9065fe6d5000 from lustre-OST0000 00000020:00000080:0.0:1787856897.470967:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787856897.470976:0:15587:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787856897.470979:0:15587:0:(genops.c:885:class_export_put()) final put ffff9064c5d31800/lustre-OST0000_UUID 00000020:00000080:0.0:1787856897.470982:0:15587:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c5d31800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787856897.470988:0:15587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787856897.471049:0:15587:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787856897.471053:0:15587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787856897.471057:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787856897.471062:0:15587:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787856897.471069:0:15587:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9064c689c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787856897.471075:0:15587:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9064c5d9cd70) has exports, disconnecting them 00000020:00080000:0.0:1787856897.471091:0:15587:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9064c689c800), last request at 1787856635 00000020:00000080:0.0:1787856897.471096:0:15587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3851 00000020:00080000:0.0:1787856897.471104:0:15587:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9064c689c800): rc 0 00000020:00000080:0.0:1787856897.471110:0:15587:0:(genops.c:885:class_export_put()) final put ffff9064c689c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787856897.471306:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c5d31000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787856897.471321:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c689c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787856897.472324:0:15587:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787856897.472332:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787856897.472336:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787856897.472342:0:15587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787856897.472501:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856897.472510:0:15587:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787856897.472515:0:15587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787856897.472520:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856897.472523:0:15587:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787856897.472529:0:15587:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9064c6898000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787856897.472536:0:15587:0:(genops.c:1553:class_disconnect_exports()) OBD device 21 (ffff9064c5d98000) has exports, disconnecting them 00000020:00080000:1.0:1787856897.472539:0:15587:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9064c6898000), last request at 1787856635 00000020:00000080:1.0:1787856897.472544:0:15587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3866 00000020:00080000:1.0:1787856897.472570:0:15587:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9064c6898000): rc 0 00000020:00000080:2.0:1787856897.472574:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c6898800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787856897.472575:0:15587:0:(genops.c:885:class_export_put()) final put ffff9064c6898000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787856897.472585:0:8:0:(genops.c:885:class_export_put()) final put ffff9064c689b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787856897.472590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c689b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787856897.472597:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787856897.472671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c6898000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787856897.529414:0:15587:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787856897.529423:0:15587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787856897.529427:0:15587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787856897.529436:0:15587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787856897.529467:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c689f000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787856897.530797:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856897.530821:0:15587:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787856897.530826:0:15587:0:(genops.c:885:class_export_put()) final put ffff9064c689e000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787856897.530830:0:15587:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c689e000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787856897.530840:0:15587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787856897.530914:0:15587:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe6d5000 1 00000020:00000080:2.0:1787856897.530921:0:15587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3794 00000020:00000080:2.0:1787856897.530927:0:15587:0:(genops.c:885:class_export_put()) final put ffff9065fe844000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787856897.530941:0:15587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787856897.530955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe844000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787856897.530966:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787856897.530970:0:15587:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787856897.530973:0:15587:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9065fbf933a0) has no exports 00000020:00000080:2.0:1787856897.564327:0:15587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856897.564342:0:15587:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787856897.564347:0:15587:0:(genops.c:885:class_export_put()) final put ffff9065fe6d3000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787856897.564352:0:15587:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe6d3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787856897.564363:0:15587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787856897.564609:0:15587:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9065fe6d6000 00000020:02000400:2.0:1787856897.564658:0:15587:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787856898.003434:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856899.041604:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856900.049708:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856900.498321:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856880/real 1787856880] req@ffff9064c83f8f00 x1874703436392576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787856900 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856900.498368:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c83f8f00 x1874703436392576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787856900 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787856900.498453:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787856900.498479:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787856900.498485:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436392576:0@lo:38:kworker.0 00000100:00080000:1.0:1787856900.498619:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856900.498626:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856900.498629:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856900.498633:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787856900.498636:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856900.498643:0:14203:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1787856900.498650:0:14203:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787856900.498667:0:14203:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9064c723f800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856900.498722:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83fa580 x1874703436394240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856900.498748:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787856900.498752:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787856900.498853:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436394240:0@lo:38:kworker.0 00000400:00000100:3.0:1787856900.498917:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703436394240 offset 0 length 520: 4 00010000:00010000:3.0:1787856901.077027:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787856901.522638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787856901.522653:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c911024a-9030-4ea8-a782-9255ee9580a7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856901.522656:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787856901.522660:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856901.522663:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787856901.522679:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:2.0:1787856901.740031:0:15789:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787856901.749203:0:15789:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787856901.749999:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856901.750083:0:15789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856901.750103:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856901.750112:0:15789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856901.750137:0:15789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787856901.750144:0:15789:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787856901.750182:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787856901.750199:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fa580 x1874703436394240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787856925 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856901.750250:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787856901.750258:0:15789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787856901.750267:0:15789:0:(import.c:65:import_set_state_nolock()) ffff9064c723f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787856901.750272:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787856901.750276:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fa580 x1874703436394240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787856925 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856901.750283:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787856901.750304:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00010000:00010000:1.0:1787856901.750394:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856901.750404:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.750413:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856901.750417:0:7903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.750427:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856901.750436:0:7903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856901.750441:0:7903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787856901.750444:0:7903:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787856901.750446:0:7903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787856901.750464:0:7903:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9065ca4b6000 00010000:00010000:1.0:1787856901.750468:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.750476:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe000/0xc25410d92a3c3a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3a81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.750498:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856901.750500:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856901.750502:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856901.756524:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436394240:0@lo:38:kworker.0 00000100:00080000:1.0:1787856901.761697:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787856901.761721:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c82403c0 x1874703436392960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856901 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761751:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83f9a40 x1874703436393216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761775:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fbc00 x1874703436393472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761784:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fad00 x1874703436393856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856905 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761793:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fa940 x1874703436393984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856910 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761802:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff906601a3d2c0 x1874703436394112/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787856906 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761818:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787856901.761825:0:15789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787856901.761832:0:15789:0:(import.c:65:import_set_state_nolock()) ffff9065c46ee000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787856901.761838:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787856901.761842:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c82403c0 x1874703436392960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856901 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761849:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83f9a40 x1874703436393216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856902 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761857:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fbc00 x1874703436393472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856902 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761888:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fad00 x1874703436393856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856905 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761895:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83fa940 x1874703436393984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856910 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761901:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff906601a3d2c0 x1874703436394112/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787856906 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856901.761907:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787856901.761911:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:3.0:1787856901.762200:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436393984:0@lo:400:kworker.0 00000100:00100000:3.0:1787856901.762253:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874703436393216:0@lo:400:kworker.0 00000100:00100000:2.0:1787856901.762488:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436393856:0@lo:400:kworker.0 00000100:00100000:2.0:1787856901.762498:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436393472:0@lo:400:kworker.0 00000100:00100000:2.0:1787856901.762506:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874703436392960:0@lo:400:kworker.0 00000100:00100000:0.0:1787856901.762764:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874703436394112:0@lo:38:kworker.0 00010000:00010000:1.0:1787856901.767738:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.767765:0:15789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.767775:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.767783:0:15789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.767813:0:15789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856901.767822:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.767829:0:15789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.767836:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.767859:0:15789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.767881:0:15789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787856901.767886:0:15789:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787856901.767920:0:15789:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787856901.767925:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1787856901.768035:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787856901.768044:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856901.768053:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856901.768057:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856901.768066:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856901.768074:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856901.768080:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787856901.768083:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787856901.768085:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787856901.768113:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9065ca4b6000 00010000:00010000:2.0:1787856901.768118:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856901.768125:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660076a000/0xc25410d92a3c3a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3a8f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856901.768139:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856901.768142:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856901.768148:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939600 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856901.768151:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856901.768167:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856901.768173:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856901.768178:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787856901.768180:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787856901.768182:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787856901.768189:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9065ca4b6000 00010000:00010000:2.0:1787856901.768192:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856901.768199:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c3cfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3d05 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856901.768232:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856901.768234:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856901.768236:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856901.769118:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787856901.769189:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856901.769199:0:15789:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787856901.769205:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9065fe8999d0) has no exports 00000020:00080000:1.0:1787856901.769501:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9065fe8999d0) has no exports 00000020:01000000:1.0:1787856901.773009:0:15789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9064c1c28900 - data ffff9065eb02d948/ffff9064c792b400 00000020:01000000:1.0:1787856901.773576:0:15789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9064c79af660 - data ffff9065eb1fa6c0/ffff9064c7933400 00100000:10000000:0.0:1787856901.795637:0:15789:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787856901.808853:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c390e 00000020:00000080:1.0:1787856901.808873:0:15789:0:(genops.c:885:class_export_put()) final put ffff9066018a5000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787856901.808899:0:15789:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065fe85b800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787856901.808903:0:15789:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe85b800 2 00000020:01000004:1.0:1787856901.808907:0:15789:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9065fe85b800 from lustre-OST0001 00000020:00000080:1.0:1787856901.808956:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856901.808970:0:15789:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787856901.808974:0:15789:0:(genops.c:885:class_export_put()) final put ffff9064c689d800/lustre-OST0001_UUID 00000020:00000080:1.0:1787856901.808978:0:15789:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c689d800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787856901.808986:0:15789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787856901.809143:0:15789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c911024a-9030-4ea8-a782-9255ee9580a7->MGS 00010000:00010000:1.0:1787856901.809164:0:15789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065c0030600/0xc25410d92a3c3667 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c366e expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856901.809178:0:15789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065c0030600/0xc25410d92a3c3667 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c366e expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856901.809200:0:15789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787856901.809204:0:15789:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787856901.809207:0:15789:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787856901.809254:0:15789:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9065ca4b6000 00010000:00010000:1.0:1787856901.809258:0:15789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065c0030600/0xc25410d92a3c3667 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c366e expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856901.809276:0:15789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc25410d92a3c3af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856901.809282:0:15789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc25410d92a3c3af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856901.809288:0:15789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787856901.809291:0:15789:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787856901.809293:0:15789:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787856901.809304:0:15789:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9065ca4b6000 00010000:00010000:1.0:1787856901.809307:0:15789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c3aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc25410d92a3c3af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787856901.809326:0:15789:0:(import.c:65:import_set_state_nolock()) ffff9065ca4b6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787856901.809330:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787856901.809332:0:15789:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787856901.809334:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787856901.809338:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000020:00000080:3.0:1787856901.809460:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9066018a5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787856901.809535:0:15789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9064c83f9e00 x1874703436393728/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787856904 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787856901.809565:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787856901.809568:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1787856901.809649:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c911024a-9030-4ea8-a782-9255ee9580a7:3622:1874703436393728:0@lo:250:kworker.0 10000000:01000000:1.0:1787856901.809880:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787856901.809896:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3564 00000020:00000080:1.0:1787856901.809902:0:15789:0:(genops.c:885:class_export_put()) final put ffff9065c661c800/c911024a-9030-4ea8-a782-9255ee9580a7 00000020:01000000:1.0:1787856901.809918:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.106@tcp (flags='') 00000020:00000080:1.0:1787856901.809924:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856901.809929:0:15789:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787856901.809933:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9065e9fd0000) has no exports 00000020:00000080:3.0:1787856901.809976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065c661c800/c911024a-9030-4ea8-a782-9255ee9580a7 for MGC192.168.202.106@tcp 10000000:01000000:1.0:1787856901.810487:0:6493:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787856901.810649:0:15789:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.106@tcp: client import never connected 00000100:00080000:2.0:1787856901.810653:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787856901.810656:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787856901.810658:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787856901.810661:0:15789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787856901.810783:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787856901.810790:0:15789:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.106@tcp (uuid c911024a-9030-4ea8-a782-9255ee9580a7) 00000020:01000000:2.0:1787856901.810798:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787856901.810803:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787856901.810815:0:15789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787856901.810821:0:15789:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9064c723b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787856901.810826:0:15789:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9064c78619d0) has exports, disconnecting them 00000020:00080000:2.0:1787856901.810831:0:15789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9064c723b000), last request at 1787856658 00000020:00000080:2.0:1787856901.810836:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c3938 00000020:00080000:2.0:1787856901.810848:0:15789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9064c723b000): rc 0 00000020:00000080:2.0:1787856901.810854:0:15789:0:(genops.c:885:class_export_put()) final put ffff9064c723b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787856901.810875:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065ca4b6000 for MGC192.168.202.106@tcp 00000020:00000080:3.0:1787856901.810882:0:8:0:(genops.c:885:class_export_put()) final put ffff9065ca4b7000/c911024a-9030-4ea8-a782-9255ee9580a7 00000020:00000080:3.0:1787856901.810884:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9065ca4b7000/c911024a-9030-4ea8-a782-9255ee9580a7 for MGC192.168.202.106@tcp 00000020:01000000:3.0:1787856901.810889:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.106@tcp (c911024a-9030-4ea8-a782-9255ee9580a7) 00000020:00000080:3.0:1787856901.812775:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c723b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787856901.814284:0:15789:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787856901.814294:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787856901.814299:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787856901.814308:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787856901.814511:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787856901.814522:0:15789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787856901.814530:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787856901.814536:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787856901.814541:0:15789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787856901.814550:0:15789:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9065fe843800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787856901.814557:0:15789:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9065fe89b3a0) has exports, disconnecting them 00000020:00080000:3.0:1787856901.814561:0:15789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9065fe843800), last request at 1787856658 00000020:00000080:3.0:1787856901.814566:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c394d 00000020:00080000:3.0:1787856901.814586:0:15789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9065fe843800): rc 0 00000020:00000080:3.0:1787856901.814592:0:15789:0:(genops.c:885:class_export_put()) final put ffff9065fe843800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787856901.815446:0:14203:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9064c723f800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787856901.815458:0:14203:0:(genops.c:885:class_export_put()) final put ffff9064c723f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787856901.815462:0:14203:0:(genops.c:844:class_export_destroy()) destroying export ffff9064c723f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787856901.815469:0:14203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787856901.815546:0:14203:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe843800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787856901.856189:0:15789:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787856901.856202:0:15789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787856901.856207:0:15789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787856901.856328:0:15789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787856901.856509:0:14203:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9065c46ee000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787856901.856597:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787856901.856851:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787856901.856977:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787856901.857479:0:6479:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9065c84eb800:6479] 0 exiting: rc = 1 00000100:00100000:1.0:1787856901.857592:0:6480:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9065c84eac00:6480] 1 exiting: rc = 0 00000100:00100000:3.0:1787856901.857672:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.858712:0:8425:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9064c5d52600:8425] 3 exiting: rc = 0 00000100:00100000:3.0:1787856901.858871:0:6483:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9065ca49e600:6483] 2 exiting: rc = 0 00000100:00100000:1.0:1787856901.859020:0:13165:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9064c8167a00:13165] 4 exiting: rc = 0 00000100:00100000:1.0:1787856901.859482:0:6481:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9065c640c400:6481] 0 exiting: rc = 1 00000100:00100000:1.0:1787856901.859554:0:6482:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9065c6407e00:6482] 1 exiting: rc = 0 00000100:00100000:2.0:1787856901.860338:0:13166:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_005: service thread [ffff90660044f000:13166] 5 exiting: rc = 0 00000100:00100000:3.0:1787856901.860617:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860629:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860636:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860643:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860649:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860656:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860664:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860671:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860679:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860685:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860692:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860699:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860705:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860714:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860720:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860726:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860732:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860739:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860745:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860753:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860760:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860766:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860772:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860779:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860786:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860792:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860798:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860804:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860826:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860832:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860837:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860844:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860849:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860855:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860861:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860867:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860873:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860879:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860885:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860891:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860897:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860902:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860908:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860913:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860919:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860924:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860930:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860935:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860941:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860946:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860951:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860957:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860964:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860970:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860976:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.860983:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.861064:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.861073:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.863123:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.863153:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.863160:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.863166:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.863171:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.863196:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787856901.874520:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787856901.874539:0:15789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787856901.874546:0:15789:0:(genops.c:885:class_export_put()) final put ffff9065fe847800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787856901.874552:0:15789:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe847800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787856901.874559:0:15789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787856901.874650:0:15789:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe85b800 1 00000020:00000080:1.0:1787856901.874657:0:15789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc25410d92a3c38dd 00000020:00000080:1.0:1787856901.874666:0:15789:0:(genops.c:885:class_export_put()) final put ffff9065fe859000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787856901.874815:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787856901.874821:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787856901.874827:0:15789:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787856901.874832:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9064c5d999d0) has no exports 00000020:00000080:3.0:1787856901.878163:0:14203:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe859000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787856901.912505:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787856901.912525:0:15789:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787856901.912533:0:15789:0:(genops.c:885:class_export_put()) final put ffff9065fe858000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787856901.912539:0:15789:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe858000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787856901.912546:0:15789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787856901.912966:0:15789:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9065fe85f000 00000020:01000000:3.0:1787856901.913159:0:15789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787856901.913166:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787856901.913171:0:15789:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787856901.913176:0:15789:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9065fe7133a0) has no exports 00000020:00000080:3.0:1787856901.913214:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787856901.913250:0:15789:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787856901.913253:0:15789:0:(genops.c:885:class_export_put()) final put ffff9065fe845000/OSS_uuid 00000020:00000080:3.0:1787856901.913256:0:15789:0:(genops.c:844:class_export_destroy()) destroying export ffff9065fe845000/OSS_uuid for OSS 00000020:01000000:3.0:1787856901.913261:0:15789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787856901.913590:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9065c2e68e00:8410] 2 exiting: rc = 0 00000100:00100000:3.0:1787856901.913695:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9065f5cc1200:8407] 0 exiting: rc = 1 00000100:00100000:2.0:1787856901.913800:0:10490:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9065eb5f0600:10490] 3 exiting: rc = 0 00000100:00100000:1.0:1787856901.914173:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9066005a4600:8409] 1 exiting: rc = 0 00000100:00100000:3.0:1787856901.915569:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915584:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915600:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915619:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915629:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915636:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915642:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915649:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915670:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915678:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915685:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915691:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915698:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915703:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915733:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915740:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915746:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915752:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915757:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915765:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915771:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915777:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915783:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915790:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915795:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915801:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915807:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915813:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915820:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915826:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915833:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915839:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915845:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915851:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915857:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915862:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915868:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915874:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915879:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915885:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915891:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915896:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915901:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915908:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915913:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915918:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915925:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915931:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915936:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915950:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915956:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915962:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915968:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915974:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915979:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.915984:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.917141:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.917164:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.917171:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.917177:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.917184:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.917190:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.917196:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.917231:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1787856901.920823:0:6492:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787856901.921621:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90660052e800:8412] 1 exiting: rc = 0 00000100:00100000:1.0:1787856901.921830:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9066005ce400:8411] 0 exiting: rc = 1 00000100:00100000:1.0:1787856901.921918:0:10075:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9065fe88de00:10075] 2 exiting: rc = 0 00000100:00100000:3.0:1787856901.922196:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922205:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922213:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922438:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922444:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922451:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922456:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922462:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922467:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922473:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922479:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922485:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922491:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922497:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922502:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922507:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922513:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922519:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922525:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922531:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922559:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922565:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922570:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922575:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922580:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922585:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922592:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922597:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922603:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922608:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922614:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922619:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922625:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922631:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922637:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922643:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922649:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922654:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922660:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922666:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922672:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922678:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922684:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922689:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922695:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922702:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922708:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922714:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922720:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922726:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922732:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922738:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922743:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922751:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922758:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922937:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922944:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922950:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922967:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922977:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922983:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.922994:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.923155:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.923166:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787856901.925203:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9066005cee00:8414] 1 exiting: rc = 0 00000100:00100000:2.0:1787856901.926643:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9065f72cc600:8415] 2 exiting: rc = 0 00000100:00100000:1.0:1787856901.927479:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9066005ce600:8413] 0 exiting: rc = 1 00000100:00100000:3.0:1787856901.927630:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927640:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927660:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927669:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927677:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927684:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927691:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927697:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927703:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927709:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927716:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927722:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927729:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927735:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927741:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927747:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927753:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927759:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927814:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927834:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927841:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927848:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927855:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927861:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927867:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927873:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927895:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927901:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927907:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927913:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927918:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927924:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927930:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927936:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927942:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927948:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927953:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927959:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927964:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927972:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927977:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927983:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.927988:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928155:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928164:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928169:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928175:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928180:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928186:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928192:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928198:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928204:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928546:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928555:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928561:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928568:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928574:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928594:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928602:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928608:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928615:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.928631:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.933769:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787856901.933800:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787856901.942533:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9066005d1400:8417] 1 exiting: rc = 0 00000100:00100000:1.0:1787856901.942818:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9065fe70ee00:8416] 0 exiting: rc = 1 00000100:00100000:2.0:1787856901.942979:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.942989:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943006:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943012:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943019:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943024:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943030:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943036:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943042:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943048:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943060:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943068:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943314:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943321:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943327:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943333:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943446:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943453:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943459:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943464:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943469:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943475:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943481:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943487:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943492:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943497:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943502:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943508:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943513:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943517:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943522:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943526:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943531:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943537:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943542:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943548:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943554:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943560:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943566:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943572:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943579:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943584:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943590:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943598:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943604:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943611:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943617:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943623:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943629:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943635:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943641:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943655:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943660:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943666:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943672:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943677:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943683:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943688:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943693:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943698:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943703:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943708:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943714:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.943720:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787856901.945972:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff906600444e00:8418] 0 exiting: rc = 1 00000100:00100000:0.0:1787856901.946592:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff906600444c00:8419] 1 exiting: rc = 0 00000100:00100000:2.0:1787856901.946816:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946827:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946834:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946842:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946850:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946857:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946864:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946871:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946877:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946915:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946926:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946935:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946942:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946949:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946956:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946963:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946973:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946981:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.946988:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947152:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947161:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947184:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947211:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947487:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947496:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947502:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947510:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947518:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947525:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947531:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947537:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947544:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947551:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947574:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947582:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947588:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947596:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947603:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947611:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947618:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947625:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947632:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947639:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947646:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947653:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947673:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947681:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947687:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947693:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947700:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947707:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947712:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947719:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947725:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947732:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947738:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947747:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947776:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947784:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947791:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947799:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947806:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947813:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787856901.947827:0:15789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787856901.965888:0:15789:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787856923.142037:0:16553:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787856933.425025:0:17153:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787856933.425032:0:17153:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787856933.425033:0:17153:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787856933.425140:0:17153:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9065c52b7000 00000020:01000004:3.0:1787856933.425157:0:17153:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787856933.425165:0:17153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787856933.425179:0:17153:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9064c8084d70) 00000020:00000080:3.0:1787856933.425191:0:17153:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787856933.491199:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.492675:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787856933.494200:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787856933.495332:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.495530:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.495754:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.495985:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.496297:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.496520:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.496748:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.496972:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.497336:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.497524:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.499001:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.499401:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.499855:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.500410:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.500698:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.501100:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.501349:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.501599:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.501934:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.502859:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.503267:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.503653:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.503935:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.504295:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.505850:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.506279:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.506722:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.507884:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.508247:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.508554:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.508877:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787856933.509156:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787856933.515313:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787856933.515964:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787856933.517196:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787856933.517665:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787856933.517963:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787856933.519673:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787856933.520204:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787856933.520996:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787856933.521966:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787856933.522407:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787856933.522733:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787856933.522999:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787856933.524871:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787856933.531084:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787856933.531750:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787856933.532739:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787856933.533040:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787856933.534182:0:17153:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1787856933.534721:0:17153:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787856933.535427:0:17153:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787856933.535435:0:17153:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787856933.535446:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c4b21 00000020:01000004:3.0:1787856933.535452:0:17153:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787856933.535457:0:17153:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787856933.535462:0:17153:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9065c52b7000 from MGS 00000020:01000004:3.0:1787856933.535465:0:17153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787856933.535475:0:17153:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9064c8080000) 00000020:00000080:3.0:1787856933.535483:0:17153:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787856933.536415:0:17153:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065c52b7000 from MGS, refs=2 00080000:01000000:3.0:1787856933.536425:0:17153:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787856933.536436:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c4b2f 00000100:00100000:3.0:1787856933.536562:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787856933.536707:0:17153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787856933.536713:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787856933.537930:0:17153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787856933.537939:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787856933.539833:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787856933.540262:0:17153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787856933.540269:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787856933.541767:0:17153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787856933.541865:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787856933.544160:0:17153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787856933.544174:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787856933.547698:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856933.547703:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856933.547705:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856933.548042:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856933.548045:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856933.548047:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856933.548732:0:17153:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787856933.557020:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787856933.560415:0:17153:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787856933.561945:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787856933.562525:0:17153:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787856933.562696:0:17153:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787856933.563321:0:17153:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787856933.563677:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787856933.563851:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787856933.563857:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787856933.564659:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787856933.564666:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787856933.565281:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787856933.565289:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787856933.566718:0:17153:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787856933.566739:0:17153:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.106@tcp' 00000020:01000004:2.0:1787856933.566741:0:17153:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787856933.566770:0:17153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.106@tcp (typ=mgc) 00000020:00000080:2.0:1787856933.566784:0:17153:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.106@tcp (ffff9065fe710000) 00000020:00000080:2.0:1787856933.566810:0:17153:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787856933.566895:0:17153:0:(ldlm_lib.c:102:import_set_conn()) imp ffff906601a75800@MGC192.168.202.106@tcp: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1787856933.567056:0:17153:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.106@tcp-0 is initialized 00000040:01000000:2.0:1787856933.567064:0:17153:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787856933.568835:0:17169:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787856933.569294:0:17170:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787856933.569348:0:17153:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.106@tcp (uuid 89af8fbc-7ed9-4ab1-8779-5ad6bfebb681) 00000020:00000080:2.0:1787856933.569371:0:17153:0:(genops.c:1385:class_connect()) connect: client 89af8fbc-7ed9-4ab1-8779-5ad6bfebb681, cookie 0xc25410d92a3c4b3d 00000100:00080000:2.0:1787856933.569384:0:17153:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787856933.569390:0:17153:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff906601a75800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856933.569426:0:17153:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c826c000 x1874703436394368/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787856933.569505:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3622:1874703436394368:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787856933.569590:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787856933.569658:0:17153:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 89af8fbc-7ed9-4ab1-8779-5ad6bfebb681->MGS 00000020:01000004:2.0:1787856933.569681:0:17153:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787856933.569687:0:17153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787856933.569711:0:17153:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9065fe7133a0) 00000020:00000080:2.0:1787856933.569724:0:17153:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787856933.572903:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436394368 00000100:00100000:1.0:1787856933.572918:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436394368 00000100:00100000:1.0:1787856933.572957:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787856933.572966:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1874703436394368:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787856933.573005:0:17166:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 89af8fbc-7ed9-4ab1-8779-5ad6bfebb681@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:1.0:1787856933.573034:0:17166:0:(genops.c:1385:class_connect()) connect: client 89af8fbc-7ed9-4ab1-8779-5ad6bfebb681, cookie 0xc25410d92a3c4b4b 00000100:00080000:1.0:1787856933.573166:0:17166:0:(import.c:65:import_set_state_nolock()) ffff9065eb522000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787856933.576484:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+5:3622:x1874703436394368:12345-0@lo:250:mount.lustre.0 Request processed in 3507us (6883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856933.576501:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787856933.577269:0:3622:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787856933.577282:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1787856933.577292:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787856933.577297:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787856933.577302:0:3622:0:(import.c:65:import_set_state_nolock()) ffff906601a75800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787856933.577305:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787856933.577324:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787856933.577330:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3622:1874703436394368:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787856933.579472:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787856933.579722:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787856933.579729:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787856933.585345:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787856933.585360:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787856933.587717:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787856933.587733:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787856933.593400:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787856933.593583:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787856933.593590:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787856933.598115:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787856933.598130:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787856933.653325:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787856933.656124:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787856933.656140:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787856933.657619:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787856933.657631:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787856933.658204:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787856933.658469:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787856933.658475:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787856933.660319:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787856933.660340:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787856933.661312:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787856933.661487:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787856933.661493:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787856933.667694:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787856933.667714:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787856933.668425:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787856933.668608:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787856933.668614:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787856933.675085:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787856933.675108:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787856933.692809:0:17153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787856933.693040:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787856933.693049:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787856933.695061:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787856933.695078:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787856933.697351:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787856933.697366:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787856933.698696:0:17153:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787856933.698741:0:17153:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787856933.698749:0:17153:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787856933.698865:0:17153:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787856933.698911:0:17153:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787856933.698916:0:17153:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787856933.698917:0:17153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856933.698919:0:17153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856933.698920:0:17153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856933.698921:0:17153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856933.698923:0:17153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856933.698924:0:17153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856933.698926:0:17153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787856933.698928:0:17153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856933.698929:0:17153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787856933.698932:0:17153:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787856933.698934:0:17153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787856933.698936:0:17153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856933.698937:0:17153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856933.698938:0:17153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856933.698939:0:17153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856933.698941:0:17153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856933.698943:0:17153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856933.698944:0:17153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787856933.698945:0:17153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856933.698946:0:17153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787856933.698983:0:17153:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787856933.699003:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436394496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787856933.699074:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856933.699121:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ce600 going to sleep for 11 seconds 00000100:00100000:1.0:1787856933.699426:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436394496 00000100:00100000:1.0:1787856933.699435:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436394496 00000100:00100000:1.0:1787856933.699475:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856933.699483:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+5:17153:x1874703436394496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787856933.699530:0:17168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787856933.699533:0:17168:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787856933.699536:0:17168:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787856933.699968:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787856933.703641:0:17168:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1787856933.705470:0:17191:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787856933.705478:0:17191:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787856933.705480:0:17191:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787856933.705483:0:17191:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787856933.705703:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787856933.706066:0:17168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787856933.706079:0:17168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787856933.710614:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+5:17153:x1874703436394496:12345-0@lo:253:mount.lustre.0 Request processed in 11123us (11531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856933.710631:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787856933.711068:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436394496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787856933.711085:0:17153:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787856933.711088:0:17153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787856933.711090:0:17153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856933.711091:0:17153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856933.711092:0:17153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856933.711094:0:17153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856933.711095:0:17153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856933.711096:0:17153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856933.711098:0:17153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787856933.711100:0:17153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856933.711101:0:17153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787856933.711123:0:17153:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9065c52b7000 from lustre-MDT0000 10000000:01000000:2.0:1787856933.711158:0:17153:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787856933.711161:0:17153:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787856933.711165:0:17153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9065fe710000 10000000:01000000:2.0:1787856933.711171:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787856933.711180:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9065fe710000 from 1 10000000:01000000:2.0:1787856933.711184:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787856933.711269:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.711281:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.711290:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856933.711311:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436394624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787856933.711368:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856933.711399:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ce3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856933.714179:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436394624 00000100:00100000:1.0:1787856933.714193:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436394624 00000100:00100000:1.0:1787856933.714282:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856933.714294:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+5:17153:x1874703436394624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856933.714310:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856933.714334:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601938200/0xc25410d92a3c4b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4b52 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856933.714361:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601938200/0xc25410d92a3c4b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4b52 expref: 6 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856933.714387:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601938200/0xc25410d92a3c4b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4b52 expref: 6 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856933.714395:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938200, rc 0) 00000100:00100000:1.0:1787856933.714468:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+6:17153:x1874703436394624:12345-0@lo:101:mount.lustre.0 Request processed in 177us (3099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856933.714475:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787856933.716667:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436394624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856933.716701:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.716714:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856933.716947:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436394752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856933.717016:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856933.717056:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ce3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856933.717150:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436394752 00000100:00100000:0.0:1787856933.717157:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436394752 00000100:00100000:0.0:1787856933.717211:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856933.717263:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+6:17153:x1874703436394752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856933.717374:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+6:17153:x1874703436394752:12345-0@lo:501:mount.lustre.0 Request processed in 113us (357us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787856933.717382:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856933.717502:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436394752:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787856933.717537:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787856933.717553:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.717562:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856933.717570:0:17153:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9065c52b7000 10000000:01000000:3.0:1787856933.717590:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787856933.717595:0:17153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9065c52b7000 10000000:01000000:3.0:1787856933.717598:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787856933.717601:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9065c52b7000 from 1 10000000:01000000:3.0:1787856933.717603:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787856933.717630:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c8c00/0xc25410d92a3c4b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.717651:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065c13c8c00/0xc25410d92a3c4b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.717659:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065c13c8c00/0xc25410d92a3c4b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856933.717673:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436394880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787856933.717703:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.717730:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436394880 00000100:00100000:3.0:1787856933.717734:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436394880 00000100:00100000:3.0:1787856933.717761:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787856933.717768:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+6:17153:x1874703436394880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856933.717860:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856933.717876:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c4b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4b60 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.717895:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c4b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4b60 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.717906:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c9000/0xc25410d92a3c4b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4b60 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.717914:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9000, rc 0) 00000100:00100000:3.0:1787856933.717940:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+7:17153:x1874703436394880:12345-0@lo:101:mount.lustre.0 Request processed in 173us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856933.717946:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787856933.717980:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ca683480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856933.718000:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436394880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856933.718011:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065c13c8c00/0xc25410d92a3c4b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b67 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.718019:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065c13c8c00/0xc25410d92a3c4b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4b67 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856933.718030:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787856933.718039:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c8c00/0xc25410d92a3c4b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b67 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.718046:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065c13c8c00/0xc25410d92a3c4b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b67 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856933.718052:0:17153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787856933.718066:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787856933.718070:0:17153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9065c52b7000 10000000:01000000:3.0:1787856933.718073:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787856933.718075:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787856933.718077:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787856933.718091:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c8000/0xc25410d92a3c4b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.718098:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065c13c8000/0xc25410d92a3c4b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.718105:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065c13c8000/0xc25410d92a3c4b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856933.718117:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436395008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787856933.718149:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.718170:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436395008 00000100:00100000:3.0:1787856933.718173:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436395008 00000100:00100000:3.0:1787856933.718194:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856933.718200:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+7:17153:x1874703436395008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856933.718207:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856933.718248:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c8a00/0xc25410d92a3c4b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4b6e expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.718262:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c8a00/0xc25410d92a3c4b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4b6e expref: 8 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.718270:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c8a00/0xc25410d92a3c4b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4b6e expref: 8 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.718275:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c8a00, rc 0) 00000100:00100000:3.0:1787856933.718299:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+8:17153:x1874703436395008:12345-0@lo:101:mount.lustre.0 Request processed in 99us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856933.718304:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856933.718330:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ca683480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856933.718341:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436395008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856933.718350:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065c13c8000/0xc25410d92a3c4b6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.718357:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065c13c8000/0xc25410d92a3c4b6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4b75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856933.718401:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436395136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856933.718431:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.718451:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436395136 00000100:00100000:3.0:1787856933.718454:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436395136 00000100:00100000:3.0:1787856933.718475:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856933.718481:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+8:17153:x1874703436395136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856933.718592:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+9:17153:x1874703436395136:12345-0@lo:501:mount.lustre.0 Request processed in 109us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856933.718599:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856933.718626:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ca683480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856933.718640:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436395136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856933.718665:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436395264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787856933.718704:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.718723:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436395264 00000100:00100000:3.0:1787856933.718726:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436395264 00000100:00100000:3.0:1787856933.718747:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856933.718753:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+9:17153:x1874703436395264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856933.719715:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ca683480 going to sleep for 11 seconds 00000100:00100000:0.0:1787856933.725862:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+9:17153:x1874703436395264:12345-0@lo:503:mount.lustre.0 Request processed in 7098us (7147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856933.725880:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856933.726116:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436395264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856933.727627:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17192:1874703436395392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856933.727708:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856933.727759:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ce3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856933.727941:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436395392 00000100:00100000:3.0:1787856933.727948:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436395392 00000100:00100000:3.0:1787856933.727996:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856933.728007:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+9:17192:x1874703436395392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856933.729020:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+9:17192:x1874703436395392:12345-0@lo:502:llog_process_th.0 Request processed in 1011us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856933.729041:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787856933.734578:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17192:1874703436395392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856933.734638:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856933.734654:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.734656:0:17192:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787856933.734661:0:17192:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787856933.734666:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856933.734684:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9065fe7119d0) 00000020:00000080:2.0:1787856933.734703:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787856933.734709:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787856933.735143:0:17192:0:(osd_handler.c:8928:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787856933.735154:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c4b83 00000020:00000080:2.0:1787856933.735554:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787856933.735560:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856933.735564:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.735566:0:17192:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787856933.735569:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856933.735573:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.735575:0:17192:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787856933.735578:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856933.735588:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9065fe714d70) 00000020:00000080:2.0:1787856933.735599:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787856933.735603:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787856933.735606:0:17192:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787856933.735608:0:17192:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787856933.735614:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787856933.735659:0:17192:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065c52b7000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787856933.735673:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9065fe89b3a0) 00000020:00000080:2.0:1787856933.735681:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787856933.735879:0:17192:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787856933.735886:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c4b98 00000020:00000080:2.0:1787856933.735981:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787856933.735987:0:17192:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787856933.735991:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc25410d92a3c4b9f 00080000:01000000:2.0:1787856933.735996:0:17192:0:(osd_handler.c:8928:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787856933.735999:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c4ba6 00010000:00010000:2.0:1787856933.857481:0:17192:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787856933.858569:0:17192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787856933.859189:0:17192:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787856933.859630:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9065fe8999d0) 00000020:00000080:2.0:1787856933.859647:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787856933.859714:0:17192:0:(osd_handler.c:8928:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787856933.859721:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c4bb4 00000020:00000080:2.0:1787856933.860599:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787856933.873407:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc25410d92a3c4bbb 00000020:00000080:2.0:1787856933.875339:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787856933.875354:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856933.875362:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.875364:0:17192:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787856933.875367:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787856933.875370:0:17192:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787856933.875372:0:17192:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787856933.875373:0:17192:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787856933.875375:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787856933.875377:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.875379:0:17192:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787856933.875381:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856933.875386:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.875387:0:17192:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787856933.875392:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787856933.875440:0:17192:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787856933.875455:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856933.875458:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.875460:0:17192:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787856933.875462:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856933.875466:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.875467:0:17192:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787856933.875470:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787856933.875475:0:17192:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:2.0:1787856933.875501:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856933.875516:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9065fe898000) 00000020:00000080:2.0:1787856933.875532:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787856933.875538:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787856933.875610:0:17192:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787856933.875615:0:17192:0:(osd_handler.c:8928:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787856933.875622:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c4bc9 00010000:00080000:2.0:1787856933.875662:0:17192:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9066018a2800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1787856933.883756:0:17192:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787856933.886201:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787856933.886247:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787856933.886284:0:17192:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787856933.886303:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c4bd0 00000100:00080000:2.0:1787856933.886314:0:17192:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787856933.886319:0:17192:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9066018a2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856933.886356:0:17192:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c826cb40 x1874703436395520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787856933.886385:0:17192:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787856933.886462:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856933.886466:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.886468:0:17192:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787856933.886471:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787856933.886473:0:17192:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787856933.886475:0:17192:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787856933.886476:0:17192:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787856933.886477:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787856933.886480:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.886481:0:17192:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787856933.886484:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787856933.886488:0:17192:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787856933.886492:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.886494:0:17192:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787856933.886497:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787856933.886500:0:17192:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:2.0:1787856933.886523:0:17192:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787856933.886526:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856933.886537:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9065fe89cd70) 00000020:00000080:2.0:1787856933.886549:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787856933.886553:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787856933.886612:0:17192:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787856933.886618:0:17192:0:(osd_handler.c:8928:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787856933.886623:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c4bde 00010000:00080000:2.0:1787856933.886651:0:17192:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9065c8dae800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:1.0:1787856933.888243:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436395520:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787856933.888322:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.888500:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436395520 00000100:00100000:3.0:1787856933.888508:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436395520 00000100:00100000:3.0:1787856933.888544:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856933.888564:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436395520:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787856933.888582:0:17179:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1787856933.890455:0:17192:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787856933.897262:0:17192:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787856933.900166:0:17192:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787856933.908606:0:17192:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856933.912068:0:17192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787856933.921089:0:17192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787856933.925500:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787856933.925510:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1787856933.926946:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436395520:12345-0@lo:38:llog_process_th.0 Request processed in 38376us (38618us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787856933.926960:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787856933.928095:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856933.928103:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787856933.928107:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436395520:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1787856933.932939:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787856933.932956:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787856933.933005:0:17192:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787856933.933028:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c4be5 00000100:00080000:2.0:1787856933.933039:0:17192:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787856933.933045:0:17192:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9065c8dae800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856933.933082:0:17192:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c826e580 x1874703436395648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787856933.933154:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436395648:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787856933.933260:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436395648 offset 0 length 520: 4 00000100:00080000:2.0:1787856933.933369:0:17192:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787856933.933438:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856933.933442:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.933444:0:17192:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787856933.933448:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787856933.933451:0:17192:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1787856933.933667:0:17192:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787856933.933670:0:17192:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787856933.933672:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787856933.933676:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.933677:0:17192:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787856933.933680:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787856933.933684:0:17192:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787856933.933687:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.933695:0:17192:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787856933.933699:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787856933.933702:0:17192:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:2.0:1787856933.933734:0:17192:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787856933.933737:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856933.933757:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9065c72db3a0) 00000020:00000080:2.0:1787856933.933777:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787856933.933786:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787856933.933930:0:17192:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787856933.933938:0:17192:0:(osd_handler.c:8928:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787856933.933944:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc25410d92a3c4bf3 00010000:00080000:2.0:1787856933.933975:0:17192:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9066007b3800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1787856933.934206:0:17192:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787856933.935118:0:17192:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787856933.935135:0:17192:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787856933.951129:0:17192:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856933.951661:0:17192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787856933.951859:0:17192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787856933.953524:0:17200:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787856933.953531:0:17200:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787856933.954929:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787856933.954945:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787856933.955000:0:17192:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787856933.955023:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c4bfa 00000100:00080000:1.0:1787856933.955035:0:17192:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856933.955041:0:17192:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9066007b3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856933.955076:0:17192:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83fb840 x1874703436395776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856933.955104:0:17192:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787856933.955168:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856933.955172:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856933.955174:0:17192:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787856933.955184:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856933.955188:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856933.955189:0:17192:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787856933.955192:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787856933.955194:0:17192:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787856933.955197:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856933.955200:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856933.955201:0:17192:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787856933.955203:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856933.955205:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856933.955206:0:17192:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787856933.955210:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787856933.955292:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17192:1874703436395904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856933.955369:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856933.955405:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856933.958880:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436395904 00000100:00100000:0.0:1787856933.958894:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436395904 00000100:00100000:0.0:1787856933.958967:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787856933.959150:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+9:17192:x1874703436395904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856933.959386:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+9:17192:x1874703436395904:12345-0@lo:502:llog_process_th.0 Request processed in 240us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856933.959394:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787856933.959449:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436395776:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787856933.959481:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436395776 offset 0 length 520: 4 00000100:00100000:1.0:1787856933.959924:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17192:1874703436395904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787856933.959959:0:17192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856933.959966:0:17192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856933.959969:0:17192:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787856933.960100:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787856933.960352:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787856933.960374:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787856933.960391:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c8000/0xc25410d92a3c4b6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.960402:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065c13c8000/0xc25410d92a3c4b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856933.960409:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065c52b7000 from 1 10000000:01000000:0.0:1787856933.960412:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787856933.960445:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.960464:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.960474:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856933.960492:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8240b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787856933.960531:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856933.960563:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787856933.961707:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436396032 00000100:00100000:3.0:1787856933.961728:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436396032 00000100:00100000:0.0:1787856933.961957:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856933.962142:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+9:17153:x1874703436396032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787856933.962158:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856933.962178:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4c01 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.962574:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 10 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.962588:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 10 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.962597:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bac00, rc 0) 00000100:00100000:0.0:1787856933.962729:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+10:17153:x1874703436396032:12345-0@lo:101:mount.lustre.0 Request processed in 592us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856933.962738:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787856933.963012:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8240b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856933.963030:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.963040:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856933.964187:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396160:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787856933.964374:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856933.964466:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787856933.967009:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436396160 00000100:00100000:2.0:1787856933.967026:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436396160 00000100:00100000:2.0:1787856933.967097:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787856933.967108:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+10:17153:x1874703436396160:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787856933.967136:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787856933.967143:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787856933.967578:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+10:17153:x1874703436396160:12345-0@lo:256:mount.lustre.0 Request processed in 472us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856933.967586:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787856933.967820:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396160:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787856933.968502:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787856933.968591:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.968604:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856933.968612:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065c52b7000 from 1 10000000:01000000:2.0:1787856933.968615:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787856933.968653:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.968663:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.968672:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856933.968692:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787856933.968738:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856933.968851:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb444b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856933.971339:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436396288 00000100:00100000:0.0:1787856933.971352:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436396288 00000100:00100000:0.0:1787856933.971406:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856933.971414:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+10:17153:x1874703436396288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787856933.971432:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856933.971449:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4c0f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.971475:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 11 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.971503:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 11 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856933.971512:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbe00, rc 0) 00000100:00100000:0.0:1787856933.971576:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17153:x1874703436396288:12345-0@lo:101:mount.lustre.0 Request processed in 163us (2840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856933.971582:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787856933.971958:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856933.971976:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.971986:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856933.972092:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856933.972128:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856933.972165:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb444b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856933.972421:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436396416 00000100:00100000:3.0:1787856933.972426:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436396416 00000100:00100000:3.0:1787856933.972455:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856933.972462:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17153:x1874703436396416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856933.972589:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17153:x1874703436396416:12345-0@lo:501:mount.lustre.0 Request processed in 126us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856933.972596:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787856933.972707:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856933.972905:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856933.972943:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856933.973012:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb444b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856933.973046:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436396544 00000100:00100000:0.0:1787856933.973050:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436396544 00000100:00100000:0.0:1787856933.973083:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787856933.973090:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17153:x1874703436396544:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787856933.973360:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17153:x1874703436396544:12345-0@lo:503:mount.lustre.0 Request processed in 270us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856933.973368:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787856933.980918:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856933.982086:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17202:1874703436396672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856933.982163:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.982327:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436396672 00000100:00100000:3.0:1787856933.982334:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436396672 00000100:00100000:3.0:1787856933.982383:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787856933.982392:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17202:x1874703436396672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856933.983047:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17202:x1874703436396672:12345-0@lo:502:llog_process_th.0 Request processed in 654us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856933.983056:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856933.983245:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb444f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856933.983268:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17202:1874703436396672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787856933.983296:0:17202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856933.983306:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.983309:0:17202:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787856933.983318:0:17202:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065c52b7000 00000020:00000080:2.0:1787856933.983320:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787856933.983330:0:17202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856933.983333:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.983335:0:17202:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787856933.983337:0:17202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856933.983339:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.983340:0:17202:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787856933.983343:0:17202:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065c52b7000 00000020:00000080:2.0:1787856933.983345:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787856933.983410:0:17202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856933.983414:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.983416:0:17202:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787856933.983419:0:17202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856933.983421:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.983423:0:17202:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787856933.983426:0:17202:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065c52b7000 00000020:00000080:2.0:1787856933.983428:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787856933.983445:0:17202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856933.983448:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.983450:0:17202:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787856933.983452:0:17202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856933.983454:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856933.983455:0:17202:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787856933.983459:0:17202:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065c52b7000 00000020:00000080:2.0:1787856933.983461:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787856933.983500:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17202:1874703436396800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856933.983542:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856933.983571:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb444f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856933.988104:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436396800 00000100:00100000:1.0:1787856933.988116:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436396800 00000100:00100000:1.0:1787856933.988175:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787856933.988185:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17202:x1874703436396800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856933.988381:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17202:x1874703436396800:12345-0@lo:502:llog_process_th.0 Request processed in 197us (4837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856933.988389:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787856933.990395:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17202:1874703436396800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787856933.990439:0:17202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856933.990452:0:17202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856933.990455:0:17202:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787856933.990460:0:17202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787856933.992632:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787856933.992672:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787856933.992703:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.992715:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856933.993725:0:17153:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787856933.993730:0:17153:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9065c52b7000 10000000:01000000:3.0:1787856933.993734:0:17153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9065c52b7000 10000000:01000000:3.0:1787856933.993738:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787856933.993744:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065c52b7000 from 1 10000000:01000000:3.0:1787856933.993746:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787856933.993798:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c4c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.993809:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c4c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.993819:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c4c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856933.993840:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787856933.993908:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.993953:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856933.994057:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436396928 00000100:00100000:2.0:1787856933.994063:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436396928 00000100:00100000:2.0:1787856933.994114:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787856933.994122:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17153:x1874703436396928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856933.994134:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856933.994148:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660215a800/0xc25410d92a3c4c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4c1d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.994169:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215a800/0xc25410d92a3c4c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4c1d expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.994180:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660215a800/0xc25410d92a3c4c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c1d expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856933.994196:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a800, rc 0) 00000100:00100000:2.0:1787856933.994260:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17153:x1874703436396928:12345-0@lo:101:mount.lustre.0 Request processed in 138us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856933.994267:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787856933.995936:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436396928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856933.995958:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c4c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c24 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856933.995969:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c4c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4c24 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856933.996048:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436397056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856933.996094:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.996132:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856933.996266:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436397056 00000100:00100000:2.0:1787856933.996271:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436397056 00000100:00100000:2.0:1787856933.996309:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787856933.996317:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17153:x1874703436397056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856933.996425:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17153:x1874703436397056:12345-0@lo:501:mount.lustre.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856933.996432:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787856933.997360:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436397056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856933.997405:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436397184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787856933.997463:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856933.997488:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856933.997559:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436397184 00000100:00100000:2.0:1787856933.997565:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436397184 00000100:00100000:2.0:1787856933.997609:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787856933.997617:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17153:x1874703436397184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856933.997707:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17153:x1874703436397184:12345-0@lo:503:mount.lustre.0 Request processed in 90us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856933.997715:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787856933.998062:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436397184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787856934.010196:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17207:1874703436397312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856934.010368:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856934.010413:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001180 going to sleep for 11 seconds 00000100:00100000:3.0:1787856934.010469:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436397312 00000100:00100000:3.0:1787856934.010476:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436397312 00000100:00100000:3.0:1787856934.010522:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787856934.010530:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17207:x1874703436397312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856934.010654:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17207:x1874703436397312:12345-0@lo:502:llog_process_th.0 Request processed in 124us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856934.010663:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856934.010752:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17207:1874703436397312:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787856934.010946:0:17207:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787856934.010960:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9065e9fd0000) 00000020:00000080:0.0:1787856934.010978:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787856934.011058:0:17207:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065c52b7000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787856934.011063:0:17207:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065c52b7000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787856934.011065:0:17207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065c52b7000 4 00010000:00080000:0.0:1787856934.011094:0:17207:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9065f71fd000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1787856934.020606:0:17207:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787856934.023394:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787856934.023449:0:17207:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787856934.023464:0:17207:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc25410d92a3c4c32 00000100:00080000:0.0:1787856934.023476:0:17207:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787856934.023483:0:17207:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9065f71fd000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856934.023518:0:17207:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c8241e00 x1874703436397440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787856934.023554:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436397440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787856934.023622:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787856934.027228:0:17207:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787856934.029017:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17207:1874703436397568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787856934.029107:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856934.029147:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9066008e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856934.031117:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436397568 00000100:00100000:2.0:1787856934.031130:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436397568 00000100:00100000:2.0:1787856934.031365:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787856934.031376:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17207:x1874703436397568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787856934.031545:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17207:x1874703436397568:12345-0@lo:502:llog_process_th.0 Request processed in 171us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856934.031553:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787856934.034318:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17207:1874703436397568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856934.034524:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8240b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17207:1874703436397696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787856934.034608:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856934.034656:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856934.034813:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436397696 00000100:00100000:2.0:1787856934.034819:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436397696 00000100:00100000:2.0:1787856934.034870:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787856934.034879:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17207:x1874703436397696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787856934.036373:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436397440 00000100:00100000:3.0:1787856934.036384:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436397440 00000100:00100000:3.0:1787856934.036431:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856934.036438:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874703436397440:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787856934.036511:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874703436397440:12345-0@lo:38:llog_process_th.0 Request processed in 71us (12888us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787856934.036519:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787856934.038484:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787856934.038497:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065f71fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856934.038504:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787856934.038508:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436397440:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787856934.038719:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17207:x1874703436397696:12345-0@lo:502:llog_process_th.0 Request processed in 3839us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856934.038731:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787856934.038855:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8240b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17207:1874703436397696:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787856934.038889:0:17207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787856934.039157:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787856934.039179:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787856934.039204:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c4c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c24 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.039311:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065c13c9a00/0xc25410d92a3c4c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c24 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787856934.039363:0:17153:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787856934.039365:0:17153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787856934.039366:0:17153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856934.039367:0:17153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856934.039368:0:17153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856934.039370:0:17153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856934.039371:0:17153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787856934.039373:0:17153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787856934.039374:0:17153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856934.039376:0:17153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787856934.039380:0:17153:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787856934.039382:0:17153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787856934.039384:0:17153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787856934.039385:0:17153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856934.039386:0:17153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856934.039387:0:17153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856934.039388:0:17153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856934.039389:0:17153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787856934.039390:0:17153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787856934.039391:0:17153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856934.039391:0:17153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787856934.039409:0:17153:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787856934.039423:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436397824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787856934.039468:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856934.039498:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856934.039503:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436397824 00000100:00100000:0.0:1787856934.039508:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436397824 00000100:00100000:0.0:1787856934.039551:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787856934.039560:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17153:x1874703436397824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787856934.039587:0:17167:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787856934.039604:0:17167:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787856934.041723:0:17167:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787856934.041765:0:17167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787856934.041866:0:17190:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787856934.041870:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787856934.041889:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856934.041910:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856934.041919:0:17190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856934.041953:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856934.041966:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 12 pid: 17168 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856934.041978:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436397952:0@lo:104: 00000100:00100000:2.0:1787856934.042022:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856934.042029:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17153:x1874703436397824:12345-0@lo:253:mount.lustre.0 Request processed in 2461us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856934.042040:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787856934.042051:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb444300 going to sleep for 11 seconds 00000100:00100000:3.0:1787856934.042244:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436397952 00000100:00100000:3.0:1787856934.042250:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436397952 00000100:00100000:2.0:1787856934.042282:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17153:1874703436397824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787856934.042287:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 10000000:01000000:2.0:1787856934.042293:0:17153:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:3.0:1787856934.042295:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436397952:12345-0@lo:104: 00000020:01000004:2.0:1787856934.042302:0:17153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787856934.042303:0:17153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787856934.042305:0:17153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856934.042306:0:17153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856934.042307:0:17153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856934.042308:0:17153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856934.042310:0:17153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856934.042311:0:17153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00010000:00010000:3.0:1787856934.042312:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787856934.042313:0:17153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856934.042314:0:17153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787856934.042327:0:17153:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787856934.042370:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787856934.042376:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436397952:12345-0@lo:104: Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856934.042382:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787856934.042399:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856934.042405:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042412:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb800 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856934.042416:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042425:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856934.042432:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856934.042438:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787856934.042459:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042463:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856934.042477:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042481:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9066007bb800/0xc25410d92a3c4c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c08 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042497:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856934.042498:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856934.042499:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856934.042520:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436398080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856934.042541:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856934.042570:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436398080 00000100:00100000:3.0:1787856934.042572:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436398080 00010000:00010000:3.0:1787856934.042583:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 12 pid: 17168 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856934.042596:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856934.042599:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:3624:x1874703436398080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856934.042606:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856934.042610:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 12 pid: 17168 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042616:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 12 pid: 17168 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042628:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042632:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787856934.042641:0:17159:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000771020s 00010000:00010000:3.0:1787856934.042643:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042656:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042660:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042664:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042667:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856934.042670:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042674:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042679:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.042685:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856934.042704:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:3624:x1874703436398080:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856934.042708:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856934.042724:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436398080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856934.045413:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4c01 expref: 11 pid: 17168 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856934.045432:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436397952:0@lo:104: 00010000:00010000:3.0:1787856934.045453:0:17190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.045470:0:17190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.045476:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856934.045482:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660215b200/0xc25410d92a3c4c39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787856934.073610:0:17153:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787856934.076327:0:17153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787856934.079491:0:17214:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787856934.079711:0:17153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:1.0:1787856934.079844:0:17213:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787856934.079849:0:17213:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1787856934.080275:0:17214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856934.082286:0:17214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787856934.082366:0:17214:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1787856934.083153:0:17215:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff906601a3d680 x1874703436398208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856934.083165:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00000040:01000000:0.0:1787856934.083499:0:17153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787856934.083554:0:17153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787856934.083986:0:17153:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787856934.083994:0:17153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787856934.084039:0:17153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856934.086715:0:17153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787856934.087909:0:17153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787856934.087963:0:17153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787856934.090413:0:17153:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1787856934.099730:0:17153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787856934.105987:0:17153:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787856934.106033:0:17153:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae99c199f988 00100000:10000000:1.0:1787856934.106041:0:17153:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787856934.107174:0:17153:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787856934.107191:0:17153:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787856934.107212:0:17153:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1787856934.107267:0:17153:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787856934.107992:0:17153:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856934.108191:0:17153:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787856934.609551:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787856935.061976:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787856935.129429:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 10000000:01000000:0.0:1787856935.505409:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787856935.505418:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065c52b7000 from 7 10000000:01000000:0.0:1787856935.505423:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787856935.505471:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856935.505482:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856935.505493:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856935.505518:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436398336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787856935.505596:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856935.505786:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436398336 00000100:00100000:2.0:1787856935.505793:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436398336 00000100:00100000:2.0:1787856935.505848:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787856935.505858:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+11:17170:x1874703436398336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856935.505870:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856935.505884:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4c40 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856935.505928:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856935.505939:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856935.505949:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ae00, rc 0) 00000100:00100000:2.0:1787856935.506009:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17170:x1874703436398336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856935.506017:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787856935.506269:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ea632180 going to sleep for 11 seconds 00000100:00100000:0.0:1787856935.506293:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436398336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856935.506308:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856935.506325:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856935.506379:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436398464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787856935.506413:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856935.506479:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436398464 00000100:00100000:3.0:1787856935.506484:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436398464 00000100:00100000:3.0:1787856935.506511:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787856935.506518:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17170:x1874703436398464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787856935.506532:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787856935.506547:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787856935.506550:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787856935.506618:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17170:x1874703436398464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856935.506624:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856935.510917:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ea632180 going to sleep for 11 seconds 00000100:00100000:0.0:1787856935.510965:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8241e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436398464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787856935.511552:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787856935.511565:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856935.511576:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856935.633537:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787856936.081856:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787856936.148866:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:0.0:1787856936.669290:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856937.169616:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:2.0:1787856937.693796:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856938.193318:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:0.0:1787856938.713186:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856939.225692:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00000100:00080000:2.0:1787856939.347735:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787856939.347751:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787856939.347755:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787856939.347764:0:14203:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1787856939.347770:0:14203:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787856939.347777:0:14203:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9066018a2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856939.347803:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c826f840 x1874703436398720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787856939.347820:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787856939.347824:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787856939.347826:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787856939.347829:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787856939.347832:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787856939.347846:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787856939.347848:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9065f71fd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787856939.347853:0:14203:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9065f71fd000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856939.347867:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c826e940 x1874703436398848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856939.347989:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856939.348007:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3626:1874703436398592:0@lo:400:kworker.0 00000100:00100000:1.0:1787856939.348085:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856939.348155:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436398720:0@lo:38:kworker.0 00000100:00100000:1.0:1787856939.348186:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856939.348213:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436398848:0@lo:38:kworker.0 00000100:00100000:1.0:1787856939.348283:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856939.348327:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436398720 00000100:00100000:1.0:1787856939.348334:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436398720 00000100:00100000:1.0:1787856939.348364:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856939.348371:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874703436398720:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787856939.348396:0:17180:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787856939.349643:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436398592 00000100:00100000:2.0:1787856939.349653:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436398592 00000100:00100000:2.0:1787856939.349710:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787856939.349718:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:3626:x1874703436398592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856939.349803:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:3626:x1874703436398592:12345-0@lo:400:kworker.0 Request processed in 85us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856939.349810:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787856939.350327:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436398848 00000100:00100000:2.0:1787856939.350333:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436398848 00000100:00100000:2.0:1787856939.350394:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787856939.350399:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874703436398848:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787856939.350423:0:17176:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1787856939.350458:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc25410d92a3c4c4e 00000004:00100000:2.0:1787856939.350473:0:17176:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787856939.350618:0:17176:0:(import.c:65:import_set_state_nolock()) ffff9065f719e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856939.350670:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874703436398848:12345-0@lo:38:kworker.0 Request processed in 269us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856939.350677:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787856939.352643:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9064c826e940 x1874703436398848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787856939.352665:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787856939.352673:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787856939.352679:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787856939.352681:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065f71fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787856939.352688:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874703436398848:0@lo:38:kworker.0 00000100:00100000:0.0:1787856939.352727:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3626:1874703436398592:0@lo:400:kworker.0 00000100:00100000:0.0:1787856939.384418:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874703436398720:12345-0@lo:38:kworker.0 Request processed in 36038us (36222us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787856939.384437:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787856939.385623:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856939.385644:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856939.385650:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436398720:0@lo:38:kworker.0 00000001:02000400:0.0:1787856939.540071:0:17458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787856939.731593:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856940.242606:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:0.0:1787856940.754414:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787856940.802002:0:17510:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856940.808144:0:17510:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787856941.266281:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:3.0:1787856941.780910:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787856941.948731:0:17560:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787856941.951251:0:17560:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787856942.289926:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:0.0:1787856942.801581:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856943.313374:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00000100:00100000:0.0:1787856943.507323:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856933/real 1787856933] req@ffff9064c83fb840 x1874703436395776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856943.507364:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c83fb840 x1874703436395776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856943.507375:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856933/real 1787856933] req@ffff9064c826e580 x1874703436395648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856943.507387:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c826e580 x1874703436395648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787856943.507408:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856943.507478:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787856943.507483:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436395776:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787856943.507491:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065c8dae800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787856943.507719:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787856943.507725:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787856943.507729:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856943.507734:0:14203:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1787856943.507741:0:14203:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787856943.507751:0:14203:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9066018a2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856943.507777:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3cb40 x1874703436399104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856943.507787:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856943.507790:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787856943.507792:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9065c8dae800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856943.507796:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1787856943.507799:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787856943.507802:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9065c8dae800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856943.507816:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3da40 x1874703436399232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856943.507834:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856943.507836:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787856943.507838:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856943.507842:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1787856943.507844:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787856943.507848:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9066007b3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856943.507858:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3de00 x1874703436399360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787856943.507937:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436399488:0@lo:400:kworker.0 00000100:00100000:3.0:1787856943.508038:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856943.508149:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436399488 00000100:00100000:3.0:1787856943.508160:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436399488 00000100:00100000:3.0:1787856943.508239:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856943.508250:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436399488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856943.508310:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436399488:12345-0@lo:400:kworker.0 Request processed in 62us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856943.508318:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787856943.508362:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff906601a3c780 x1874703436399488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856943.508374:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436399488:0@lo:400:kworker.0 00000100:00100000:2.0:1787856943.508800:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856943.508813:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436398976:0@lo:400:kworker.0 00000100:00100000:2.0:1787856943.508862:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856943.508959:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436398976 00000100:00100000:3.0:1787856943.508963:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436398976 00000100:00100000:3.0:1787856943.509000:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787856943.509007:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:3625:x1874703436398976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856943.509196:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:3625:x1874703436398976:12345-0@lo:400:kworker.0 Request processed in 37us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856943.509205:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787856943.509268:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436398976:0@lo:400:kworker.0 00000100:00080000:0.0:1787856943.509595:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787856943.509602:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436395648:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787856943.509977:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436399104:0@lo:38:kworker.0 00000100:00100000:0.0:1787856943.510737:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856943.510815:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436399232:0@lo:8:kworker.0 00000100:00100000:3.0:1787856943.510847:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436399104 00000100:00100000:3.0:1787856943.510857:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436399104 00000400:00000100:0.0:1787856943.510867:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436399232 offset 0 length 520: 4 00000100:00100000:0.0:1787856943.510915:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436399360:0@lo:8:kworker.0 00000400:00000100:0.0:1787856943.510937:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436399360 offset 0 length 520: 4 00000100:00100000:3.0:1787856943.513079:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856943.513091:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436399104:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787856943.513139:0:17179:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787856943.547264:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436399104:12345-0@lo:38:kworker.0 Request processed in 34157us (36518us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787856943.547283:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787856943.547503:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856943.547511:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856943.547517:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436399104:0@lo:38:kworker.0 00010000:00010000:3.0:1787856943.830255:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856944.345388:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:0.0:1787856944.849572:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856945.361882:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:3.0:1787856945.873599:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787856946.326912:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787856946.385328:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:3.0:1787856946.905614:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856947.409321:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:3.0:1787856947.924634:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856948.433490:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00000100:00080000:3.0:1787856948.562344:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787856948.562351:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787856948.562355:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856948.562372:0:14203:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1787856948.562378:0:14203:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787856948.562385:0:14203:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9066018a2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856948.562407:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3e940 x1874703436399744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856948.562423:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856948.562427:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856948.562429:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856948.562432:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787856948.562469:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436399872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856948.562538:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856948.562718:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436399616:0@lo:400:kworker.0 00000100:00100000:1.0:1787856948.562756:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856948.562805:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436399744:0@lo:38:kworker.0 00000100:00100000:1.0:1787856948.562837:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856948.562896:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436399744 00000100:00100000:1.0:1787856948.562905:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436399744 00000100:00100000:1.0:1787856948.562945:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787856948.562965:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874703436399744:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787856948.562986:0:17180:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787856948.564822:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436399872 00000100:00100000:2.0:1787856948.564834:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436399872 00000100:00100000:2.0:1787856948.564892:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787856948.564902:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436399872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856948.565005:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436399872:12345-0@lo:400:kworker.0 Request processed in 105us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856948.565013:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787856948.565079:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff906601a3f840 x1874703436399872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856948.565094:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436399872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856948.565479:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436399616 00000100:00100000:3.0:1787856948.565484:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436399616 00000100:00100000:3.0:1787856948.565523:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787856948.565532:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:3624:x1874703436399616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856948.565577:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:3624:x1874703436399616:12345-0@lo:400:kworker.0 Request processed in 46us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856948.565583:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787856948.575540:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436399616:0@lo:400:kworker.0 00000100:00100000:1.0:1787856948.584797:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874703436399744:12345-0@lo:38:kworker.0 Request processed in 21834us (21950us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787856948.584816:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787856948.584898:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856948.584906:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787856948.584910:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436399744:0@lo:38:kworker.0 00010000:00010000:3.0:1787856948.967147:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856949.458398:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:2.0:1787856949.973665:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787856950.201368:0:17905:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787856950.201372:0:17905:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787856950.201373:0:17905:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787856950.201762:0:17905:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9065fe85c800 00000020:01000004:3.0:1787856950.201779:0:17905:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787856950.201790:0:17905:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787856950.201804:0:17905:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9064c80819d0) 00000020:00000080:3.0:1787856950.201820:0:17905:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787856950.293855:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787856950.294286:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.295573:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.295822:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.296113:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.296615:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.296858:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.298019:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.298277:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.298589:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.298893:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.299269:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.299690:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.299893:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.300261:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.300703:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.301027:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.301259:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.301591:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.301846:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.302110:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.302329:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.302887:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.303139:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.303377:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.303862:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.304280:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.304646:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.304880:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.305156:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.305378:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787856950.305893:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.306142:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.306561:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787856950.309734:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787856950.309934:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787856950.310614:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787856950.310908:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787856950.311130:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787856950.311477:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787856950.311783:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787856950.311998:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787856950.312295:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787856950.312581:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787856950.312870:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787856950.313077:0:17905:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1787856950.313807:0:17905:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787856950.314013:0:17905:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787856950.314025:0:17905:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787856950.314036:0:17905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c4c5c 00000020:01000004:1.0:1787856950.314043:0:17905:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787856950.314065:0:17905:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787856950.314069:0:17905:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787856950.314075:0:17905:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787856950.314101:0:17905:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787856950.314105:0:17905:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787856950.325736:0:17905:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787856950.325782:0:17905:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.106@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787856950.325787:0:17905:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787856950.325789:0:17905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787856950.325790:0:17905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856950.325792:0:17905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856950.325793:0:17905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856950.325795:0:17905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856950.325796:0:17905:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787856950.325798:0:17905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856950.325800:0:17905:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787856950.325804:0:17905:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787856950.325806:0:17905:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787856950.325807:0:17905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787856950.325809:0:17905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856950.325810:0:17905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856950.325811:0:17905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856950.325817:0:17905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856950.325818:0:17905:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787856950.325819:0:17905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856950.325820:0:17905:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787856950.325844:0:17905:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787856950.325863:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400000:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787856950.326005:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856950.326150:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c3ce6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.327301:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436400000 00000100:00100000:2.0:1787856950.327310:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436400000 00000100:00100000:2.0:1787856950.327467:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787856950.327477:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17905:x1874703436400000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787856950.327510:0:17168:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787856950.327514:0:17168:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787856950.327521:0:17168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787856950.328416:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17905:x1874703436400000:12345-0@lo:253:mount.lustre.0 Request processed in 931us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.328431:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856950.328599:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787856950.328627:0:17905:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787856950.328655:0:17905:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787856950.328657:0:17905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787856950.328658:0:17905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856950.328659:0:17905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856950.328661:0:17905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856950.328662:0:17905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856950.328663:0:17905:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787856950.328665:0:17905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856950.328667:0:17905:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787856950.328690:0:17905:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9065fe85c800 from lustre-MDT0001 10000000:01000000:1.0:1787856950.328733:0:17905:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787856950.328737:0:17905:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787856950.328746:0:17905:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9065fe710000 local copy 00010000:00010000:1.0:1787856950.328759:0:17905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856950.328901:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856950.328953:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.329004:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9c11300 going to sleep for 11 seconds 00000100:00100000:0.0:1787856950.329045:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436400128 00000100:00100000:0.0:1787856950.329055:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436400128 00000100:00100000:0.0:1787856950.329097:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787856950.329105:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17905:x1874703436400128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856950.329283:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17905:x1874703436400128:12345-0@lo:501:mount.lustre.0 Request processed in 177us (329us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787856950.329291:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787856950.329611:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400128:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787856950.330527:0:17905:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787856950.330691:0:17905:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787856950.330702:0:17905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.330715:0:17905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856950.330762:0:17905:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9065fe85c800 10000000:01000000:0.0:1787856950.330767:0:17905:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787856950.330772:0:17905:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9065fe710000 10000000:01000000:0.0:1787856950.330776:0:17905:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787856950.330780:0:17905:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9065fe710000 from 1 10000000:01000000:0.0:1787856950.330783:0:17905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787856950.330814:0:17905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007ba600/0xc25410d92a3c4c63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.330823:0:17905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9066007ba600/0xc25410d92a3c4c63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.330833:0:17905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9066007ba600/0xc25410d92a3c4c63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856950.330854:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8243840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787856950.330913:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856950.331006:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.331142:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436400256 00000100:00100000:2.0:1787856950.331149:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436400256 00000100:00100000:2.0:1787856950.331252:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787856950.331261:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+12:17905:x1874703436400256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856950.331281:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856950.331295:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660215ac00/0xc25410d92a3c4c6a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4c63 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.331330:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215ac00/0xc25410d92a3c4c6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4c63 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.331341:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660215ac00/0xc25410d92a3c4c6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c63 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.331350:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ac00, rc 0) 00000100:00100000:2.0:1787856950.331390:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+13:17905:x1874703436400256:12345-0@lo:101:mount.lustre.0 Request processed in 129us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.331396:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787856950.331515:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8243840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856950.331531:0:17905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9066007ba600/0xc25410d92a3c4c63 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c6a expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.331541:0:17905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9066007ba600/0xc25410d92a3c4c63 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4c6a expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856950.331569:0:17905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787856950.331580:0:17905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007ba600/0xc25410d92a3c4c63 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c6a expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.331587:0:17905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9066007ba600/0xc25410d92a3c4c63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c6a expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856950.331595:0:17905:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9065fe85c800 10000000:01000000:3.0:1787856950.331600:0:17905:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787856950.331604:0:17905:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9065fe85c800 from 1 10000000:01000000:3.0:1787856950.331606:0:17905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787856950.331623:0:17905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c8e00/0xc25410d92a3c4c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.331630:0:17905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065c13c8e00/0xc25410d92a3c4c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.331659:0:17905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065c13c8e00/0xc25410d92a3c4c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856950.331673:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787856950.331701:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856950.332154:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787856950.332291:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436400384 00000100:00100000:0.0:1787856950.332297:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436400384 00000100:00100000:0.0:1787856950.332334:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856950.332342:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+13:17905:x1874703436400384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787856950.332351:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856950.332361:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4c71 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.332377:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4c71 expref: 14 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.332396:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bac00/0xc25410d92a3c4c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c71 expref: 14 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.332416:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bac00, rc 0) 00000100:00100000:0.0:1787856950.332599:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+14:17905:x1874703436400384:12345-0@lo:101:mount.lustre.0 Request processed in 257us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.332606:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787856950.332776:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856950.332789:0:17905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065c13c8e00/0xc25410d92a3c4c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c78 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.332799:0:17905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065c13c8e00/0xc25410d92a3c4c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4c78 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856950.332812:0:17905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787856950.332830:0:17905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c8e00/0xc25410d92a3c4c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c78 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.332838:0:17905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065c13c8e00/0xc25410d92a3c4c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c78 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856950.332845:0:17905:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787856950.332850:0:17905:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787856950.332855:0:17905:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9065fe85c800 10000000:01000000:3.0:1787856950.332858:0:17905:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787856950.332862:0:17905:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787856950.332864:0:17905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787856950.332880:0:17905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c4c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.332895:0:17905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c4c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.332903:0:17905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c4c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856950.332918:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787856950.332946:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856950.332965:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787856950.333053:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436400512 00000100:00100000:0.0:1787856950.333057:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436400512 00000100:00100000:0.0:1787856950.333077:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787856950.333082:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+14:17905:x1874703436400512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787856950.333089:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856950.333097:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bb800/0xc25410d92a3c4c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4c7f expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.333111:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bb800/0xc25410d92a3c4c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4c7f expref: 15 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.333119:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bb800/0xc25410d92a3c4c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c7f expref: 15 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.333126:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb800, rc 0) 00000100:00100000:0.0:1787856950.333164:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436400512:12345-0@lo:101:mount.lustre.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.333170:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787856950.333302:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856950.333323:0:17905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c4c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c86 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.333332:0:17905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c4c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4c86 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787856950.336911:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1787856950.338032:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856950.345186:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787856950.345780:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787856950.345800:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787856950.345816:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787856950.345830:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1787856950.345843:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1787856950.345856:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1787856950.345965:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787856950.345987:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787856950.346001:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1787856950.346032:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1787856950.346048:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1787856950.346062:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1787856950.346076:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787856950.346089:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787856950.346102:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1787856950.346117:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787856950.346132:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787856950.346147:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1787856950.346160:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787856950.346172:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787856950.346186:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787856950.346198:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787856950.346326:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1787856950.346334:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1787856950.350056:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856950.350141:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856950.350274:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856950.352364:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436400640 00000100:00100000:0.0:1787856950.352379:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436400640 00000100:00100000:0.0:1787856950.355898:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787856950.355913:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436400640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856950.356121:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436400640:12345-0@lo:501:mount.lustre.0 Request processed in 211us (5980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.356129:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787856950.356246:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856950.356294:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787856950.356347:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856950.356718:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.356904:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436400768 00000100:00100000:2.0:1787856950.356911:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436400768 00000100:00100000:2.0:1787856950.356942:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787856950.356950:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436400768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856950.357810:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436400768:12345-0@lo:503:mount.lustre.0 Request processed in 856us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.357819:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787856950.357930:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400768:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787856950.358604:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787856950.358778:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787856950.358841:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856950.359028:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787856950.359162:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436400896 00000100:00100000:1.0:1787856950.359168:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436400896 00000100:00100000:0.0:1787856950.359247:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787856950.359257:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436400896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856950.360255:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436400896:12345-0@lo:502:mount.lustre.0 Request processed in 996us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.360265:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787856950.360382:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436400896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787856950.360852:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787856950.360899:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787856950.360916:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787856950.360928:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787856950.360940:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787856950.360953:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787856950.360966:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787856950.360978:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787856950.360988:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787856950.360998:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787856950.361009:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787856950.361021:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787856950.361034:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787856950.361047:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787856950.361058:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787856950.361070:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787856950.361083:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787856950.361110:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787856950.361127:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787856950.361141:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787856950.361154:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787856950.361167:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787856950.361179:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787856950.361193:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787856950.361206:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787856950.361248:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787856950.361264:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787856950.361277:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787856950.361291:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787856950.361303:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787856950.361315:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787856950.361328:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787856950.361351:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1787856950.361377:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787856950.361392:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1787856950.361965:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1787856950.361993:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1787856950.362008:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1787856950.362021:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1787856950.362035:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1787856950.362048:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1787856950.362063:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1787856950.362077:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1787856950.362105:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1787856950.362145:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436401024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856950.362213:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856950.365316:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22780 going to sleep for 11 seconds 00000100:00100000:1.0:1787856950.365432:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436401024 00000100:00100000:1.0:1787856950.365440:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436401024 00000100:00100000:1.0:1787856950.365497:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787856950.365507:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436401024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856950.365842:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436401024:12345-0@lo:502:mount.lustre.0 Request processed in 336us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856950.365851:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787856950.366206:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436401024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787856950.366319:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1787856950.366334:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787856950.368510:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856950.368523:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.368533:0:17909:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787856950.368540:0:17909:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787856950.368542:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787856950.368555:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9064c78619d0) 00000020:00000080:1.0:1787856950.368576:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787856950.368582:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787856950.368848:0:17909:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787856950.368859:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c4c94 00000020:00000080:1.0:1787856950.369149:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787856950.369154:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856950.369158:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.369160:0:17909:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787856950.369162:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856950.369166:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.369167:0:17909:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787856950.369171:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787856950.369179:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9064c78633a0) 00000020:00000080:1.0:1787856950.369191:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787856950.369195:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787856950.369196:0:17909:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787856950.369199:0:17909:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787856950.369205:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787856950.369346:0:17909:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065fe85c800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787856950.369359:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9064c7864d70) 00000020:00000080:1.0:1787856950.369368:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787856950.369556:0:17909:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787856950.369563:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c4ca9 00000020:00000080:1.0:1787856950.369788:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787856950.369796:0:17909:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787856950.369802:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc25410d92a3c4cb0 00080000:01000000:1.0:1787856950.369808:0:17909:0:(osd_handler.c:8928:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787856950.369811:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c4cb7 00010000:00010000:3.0:1787856950.479368:0:17909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787856950.483883:0:17909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000100:00100000:0.0:1787856950.484275:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00000001:00080000:3.0:1787856950.485140:0:17909:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787856950.489826:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787856950.489840:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856950.489847:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856950.489859:0:17909:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787856950.489866:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856950.489872:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856950.489874:0:17909:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787856950.489877:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787856950.489882:0:17909:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:2.0:1787856950.489912:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787856950.490003:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9065c72dcd70) 00000020:00000080:2.0:1787856950.490029:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787856950.490036:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787856950.490111:0:17909:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787856950.490119:0:17909:0:(osd_handler.c:8928:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787856950.490128:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c4cc5 00010000:00080000:2.0:1787856950.490159:0:17909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff906601a4e800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1787856950.495102:0:17909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787856950.505813:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787856950.505828:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787856950.505996:0:17909:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787856950.506021:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c4ccc 00000100:00080000:3.0:1787856950.506032:0:17909:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787856950.506038:0:17909:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff906601a4e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856950.506071:0:17909:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3ed00 x1874703436401152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787856950.506142:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436401152:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787856950.506271:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856950.506474:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436401152 00000100:00100000:0.0:1787856950.506482:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436401152 00000100:00100000:0.0:1787856950.506521:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787856950.506528:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874703436401152:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787856950.506551:0:17179:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1787856950.506612:0:17179:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c4cd3 00000004:00100000:0.0:1787856950.506642:0:17179:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787856950.506650:0:17179:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787856950.507133:0:17909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787856950.507212:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856950.507242:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.507245:0:17909:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787856950.507249:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787856950.507251:0:17909:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787856950.507253:0:17909:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787856950.507254:0:17909:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787856950.507264:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787856950.507266:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.507268:0:17909:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787856950.507270:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856950.507275:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.507277:0:17909:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787856950.507280:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787856950.507322:0:17909:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787856950.507342:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856950.507346:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.507347:0:17909:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787856950.507350:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787856950.507351:0:17909:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787856950.507353:0:17909:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787856950.507354:0:17909:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787856950.507356:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787856950.507358:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.507360:0:17909:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787856950.507362:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787856950.507365:0:17909:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787856950.507368:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.507369:0:17909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787856950.507372:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787856950.507375:0:17909:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:0.0:1787856950.507397:0:17909:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787856950.507400:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787856950.507414:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9065e9fd4d70) 00000100:00080000:1.0:1787856950.507530:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787856950.507541:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787856950.507544:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856950.507548:0:14203:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1787856950.507551:0:14203:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787856950.507556:0:14203:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9066018a2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856950.507589:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83fb480 x1874703436401280/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1787856950.507731:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787856950.507741:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787856950.507818:0:17909:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787856950.507825:0:17909:0:(osd_handler.c:8928:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787856950.507831:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c4ce1 00010000:00080000:0.0:1787856950.507871:0:17909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9065eb5d8800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1787856950.508094:0:17909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1787856950.509702:0:17909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787856950.510120:0:17909:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1787856950.511134:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436401280:0@lo:38:kworker.0 00000100:00100000:2.0:1787856950.511208:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787856950.511381:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856950.511387:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856950.511390:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856950.511393:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787856950.511415:0:17180:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787856950.511423:0:17180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1787856950.511590:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436401408:0@lo:400:kworker.0 00000100:00100000:1.0:1787856950.511619:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.511670:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436401408 00000100:00100000:1.0:1787856950.511677:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436401408 00000100:00100000:1.0:1787856950.511717:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856950.511726:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436401408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856950.511776:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436401408:12345-0@lo:400:kworker.0 Request processed in 51us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856950.511784:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787856950.511821:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9064c83f9680 x1874703436401408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856950.511835:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436401408:0@lo:400:kworker.0 00000100:00100000:2.0:1787856950.512167:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436401280 00000100:00100000:2.0:1787856950.512171:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436401280 00000100:00100000:1.0:1787856950.512381:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787856950.512387:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874703436401280:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787856950.512459:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874703436401280:12345-0@lo:38:kworker.0 Request processed in 71us (1251us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787856950.512466:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856950.512522:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787856950.512529:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856950.512533:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787856950.512537:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436401280:0@lo:38:kworker.0 00000040:00080000:0.0:1787856950.514608:0:17909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787856950.514885:0:17909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787856950.515028:0:17909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:0.0:1787856950.517123:0:17179:0:(import.c:65:import_set_state_nolock()) ffff9065eb5d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856950.517303:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1874703436401152:12345-0@lo:38:llog_process_th.0 Request processed in 10772us (11029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.517315:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1787856950.517407:0:17915:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787856950.517412:0:17915:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1787856950.521110:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787856950.521124:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787856950.521133:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787856950.521140:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787856950.521144:0:3622:0:(import.c:65:import_set_state_nolock()) ffff906601a4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787856950.521167:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436401152:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787856950.521458:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436401536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856950.521519:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.521770:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436401536 00000100:00100000:1.0:1787856950.521778:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436401536 00000100:00100000:1.0:1787856950.521832:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787856950.521841:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436401536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856950.521872:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787856950.521928:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1874703436401536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856950.521946:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856950.522022:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436401536:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1787856950.522848:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787856950.522862:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787856950.522906:0:17909:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787856950.522928:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c4ce8 00000100:00080000:0.0:1787856950.523133:0:17909:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787856950.523139:0:17909:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9065eb5d8800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856950.523168:0:17909:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c8242940 x1874703436401664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787856950.523252:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436401664:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787856950.523293:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436401664 offset 0 length 520: 4 00000100:00080000:0.0:1787856950.523356:0:17909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787856950.523416:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856950.523421:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.523423:0:17909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787856950.523433:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787856950.523436:0:17909:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787856950.523437:0:17909:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787856950.523439:0:17909:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787856950.523441:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787856950.523443:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.523452:0:17909:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787856950.523456:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787856950.523459:0:17909:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787856950.523463:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856950.523464:0:17909:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787856950.523467:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787856950.523470:0:17909:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:0.0:1787856950.523491:0:17909:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787856950.523494:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787856950.523505:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9065e9fd33a0) 00000020:00000080:0.0:1787856950.523518:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787856950.523523:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787856950.523585:0:17909:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787856950.523592:0:17909:0:(osd_handler.c:8928:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787856950.523599:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc25410d92a3c4cf6 00010000:00080000:0.0:1787856950.523646:0:17909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9064c8172000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.106@tcp at head 00000100:00080000:1.0:1787856950.523755:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856950.523760:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856950.523764:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856950.523767:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787856950.525069:0:17909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787856950.525141:0:17909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787856950.525156:0:17909:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787856950.527595:0:17909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787856950.527991:0:17909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787856950.528101:0:17909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787856950.529047:0:17917:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787856950.529053:0:17917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787856950.530818:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787856950.530830:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787856950.530932:0:17909:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787856950.531613:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c4cfd 00000100:00080000:1.0:1787856950.532597:0:17909:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856950.532605:0:17909:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9064c8172000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856950.532945:0:17909:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83f9680 x1874703436401792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856950.533054:0:17909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787856950.533136:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436401792:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787856950.533194:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436401792 offset 0 length 520: 4 00000020:01000000:1.0:1787856950.533366:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856950.533374:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.533377:0:17909:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787856950.533380:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856950.533384:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.533386:0:17909:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787856950.533389:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787856950.533391:0:17909:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787856950.533393:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856950.533395:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.533396:0:17909:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787856950.533400:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856950.533401:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.533403:0:17909:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787856950.533407:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787856950.533447:0:17909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856950.533450:0:17909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.533451:0:17909:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787856950.533454:0:17909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1787856950.533687:0:17905:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787856950.533718:0:17905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787856950.533739:0:17905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c4c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c86 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.533749:0:17905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065c13c9800/0xc25410d92a3c4c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4c86 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856950.533765:0:17905:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065fe85c800 from 1 10000000:01000000:2.0:1787856950.533768:0:17905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787856950.533794:0:17905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.533801:0:17905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.533812:0:17905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856950.533828:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436401920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787856950.534768:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856950.534811:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9dcf240 going to sleep for 11 seconds 00000100:00100000:3.0:1787856950.535323:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436401920 00000100:00100000:3.0:1787856950.535332:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436401920 00000100:00100000:3.0:1787856950.535386:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856950.535395:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+15:17905:x1874703436401920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856950.535410:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856950.535525:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4d04 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.535554:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 16 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.535566:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 16 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.535589:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c13c9e00, rc 0) 00000100:00100000:3.0:1787856950.535669:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:17905:x1874703436401920:12345-0@lo:101:mount.lustre.0 Request processed in 273us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856950.535676:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787856950.535829:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436401920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856950.535846:0:17905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.535868:0:17905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787856950.536566:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856950.536573:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856950.536576:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856950.536579:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787856950.537000:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402048:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787856950.537068:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856950.537142:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9dcf240 going to sleep for 11 seconds 00000100:00100000:3.0:1787856950.537191:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436402048 00000100:00100000:3.0:1787856950.537197:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436402048 00000100:00100000:3.0:1787856950.541861:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856950.541884:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:17905:x1874703436402048:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787856950.541916:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787856950.541953:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787856950.541957:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787856950.544322:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:17905:x1874703436402048:12345-0@lo:256:mount.lustre.0 Request processed in 2443us (7247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.544339:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787856950.544587:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402048:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787856950.546060:0:17905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787856950.546131:0:17905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.546144:0:17905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856950.546246:0:17905:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe85c800 from 1 10000000:01000000:1.0:1787856950.546251:0:17905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856950.546286:0:17905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.546296:0:17905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.546307:0:17905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856950.546328:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787856950.546386:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.546546:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ea632300 going to sleep for 11 seconds 00000100:00100000:3.0:1787856950.546586:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436402176 00000100:00100000:3.0:1787856950.546593:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436402176 00000100:00100000:3.0:1787856950.546751:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856950.546761:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:17905:x1874703436402176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856950.546776:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856950.546790:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4d12 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.546813:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.546824:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856950.546832:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe600, rc 0) 00000100:00100000:3.0:1787856950.546884:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402176:12345-0@lo:101:mount.lustre.0 Request processed in 124us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856950.546897:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787856950.546961:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856950.546975:0:17905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.546984:0:17905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856950.547097:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856950.547124:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856950.547151:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.547353:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ea632780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856950.547501:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436402304 00000100:00100000:0.0:1787856950.547507:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436402304 00000100:00100000:0.0:1787856950.547532:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787856950.547539:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856950.547672:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402304:12345-0@lo:501:mount.lustre.0 Request processed in 133us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.547680:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787856950.547813:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856950.547841:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787856950.547890:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.547910:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ea632780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856950.548005:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436402432 00000100:00100000:0.0:1787856950.548009:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436402432 00000100:00100000:0.0:1787856950.548026:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787856950.548032:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787856950.548109:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402432:12345-0@lo:503:mount.lustre.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.548116:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787856950.548266:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787856950.549122:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856950.549192:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856950.549280:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.549306:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ea632300 going to sleep for 11 seconds 00000100:00100000:0.0:1787856950.549365:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436402560 00000100:00100000:0.0:1787856950.549370:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436402560 00000100:00100000:0.0:1787856950.549411:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787856950.549419:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856950.549650:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402560:12345-0@lo:502:mount.lustre.0 Request processed in 231us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.549658:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787856950.549803:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856950.550093:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787856950.550121:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787856950.550145:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787856950.550158:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787856950.550187:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787856950.550204:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787856950.550254:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787856950.550272:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787856950.550286:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787856950.550298:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787856950.550312:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787856950.550336:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856950.550374:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.550405:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ea632300 going to sleep for 11 seconds 00000100:00100000:3.0:1787856950.550464:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436402688 00000100:00100000:3.0:1787856950.550470:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436402688 00000100:00100000:3.0:1787856950.550497:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787856950.550504:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787856950.550587:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402688:12345-0@lo:502:mount.lustre.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856950.550593:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787856950.550785:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856950.550823:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787856950.550832:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787856950.551347:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856950.551356:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.551359:0:17919:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787856950.551366:0:17919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065fe85c800 00000020:00000080:1.0:1787856950.551369:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787856950.551378:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856950.551380:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.551381:0:17919:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787856950.551383:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856950.551386:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.551387:0:17919:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787856950.551390:0:17919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065fe85c800 00000020:00000080:1.0:1787856950.551392:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787856950.551612:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856950.551625:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.551627:0:17919:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787856950.551630:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856950.551647:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.551649:0:17919:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787856950.551653:0:17919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065fe85c800 00000020:00000080:1.0:1787856950.551655:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787856950.554300:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856950.554331:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.554334:0:17919:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787856950.554338:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856950.554343:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.554344:0:17919:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787856950.554350:0:17919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065fe85c800 00000020:00000080:1.0:1787856950.554352:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787856950.554414:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856950.554417:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856950.554419:0:17919:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787856950.554435:0:17919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1787856950.556575:0:17905:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787856950.556630:0:17905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856950.556659:0:17905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.556672:0:17905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856950.556740:0:17905:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787856950.556744:0:17905:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9065fe85c800 10000000:01000000:1.0:1787856950.556747:0:17905:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9065fe85c800 10000000:01000000:1.0:1787856950.556751:0:17905:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787856950.556758:0:17905:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065fe85c800 from 1 10000000:01000000:1.0:1787856950.556761:0:17905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787856950.556795:0:17905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c4d20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.556815:0:17905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c4d20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.556827:0:17905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c4d20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856950.556980:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787856950.557052:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.557093:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436402816 00000100:00100000:1.0:1787856950.557099:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436402816 00000100:00100000:1.0:1787856950.557143:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787856950.557151:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17905:x1874703436402816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856950.557166:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856950.557179:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601938e00/0xc25410d92a3c4d27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4d20 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.557201:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601938e00/0xc25410d92a3c4d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4d20 expref: 18 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.557213:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601938e00/0xc25410d92a3c4d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d20 expref: 18 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.557243:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938e00, rc 0) 00000100:00100000:1.0:1787856950.557275:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436402816:12345-0@lo:101:mount.lustre.0 Request processed in 124us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856950.557281:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787856950.557323:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065ea632240 going to sleep for 11 seconds 00000100:00100000:1.0:1787856950.557349:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856950.557363:0:17905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c4d20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d27 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.557372:0:17905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c4d20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4d27 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856950.558953:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787856950.559243:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856950.559420:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787856950.561600:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1787856950.562032:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1787856950.562052:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1787856950.562066:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1787856950.562079:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1787856950.562091:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1787856950.562104:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1787856950.562118:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1787856950.562131:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1787856950.562145:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1787856950.562160:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1787856950.562190:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1787856950.562207:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1787856950.563556:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1787856950.563602:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1787856950.564578:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1787856950.565140:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1787856950.565171:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1787856950.565187:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1787856950.565201:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1787856950.565243:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1787856950.565263:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1787856950.565291:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1787856950.565306:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1787856950.565320:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1787856950.565334:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1787856950.565347:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1787856950.565389:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1787856950.565398:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787856950.566613:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856950.567371:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.568541:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22780 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.579568:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436402944 00000100:00100000:2.0:1787856950.579583:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436402944 00000100:00100000:2.0:1787856950.579943:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787856950.579956:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436402944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856950.580143:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436402944:12345-0@lo:501:mount.lustre.0 Request processed in 189us (12772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.580150:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787856950.580314:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436402944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856950.580366:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787856950.580415:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.581767:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22780 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.581838:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436403072 00000100:00100000:2.0:1787856950.581845:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436403072 00000100:00100000:2.0:1787856950.582778:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787856950.582787:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856950.583589:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403072:12345-0@lo:503:mount.lustre.0 Request processed in 801us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.583599:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787856950.583838:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403072:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787856950.584316:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856950.584393:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856950.584460:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.584493:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d9cc53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.584943:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436403200 00000100:00100000:2.0:1787856950.584949:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436403200 00000100:00100000:2.0:1787856950.584996:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787856950.585005:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856950.585109:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403200:12345-0@lo:502:mount.lustre.0 Request processed in 104us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.585116:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787856950.585568:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856950.587522:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787856950.587570:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1787856950.587585:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1787856950.587599:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1787856950.587612:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1787856950.587794:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1787856950.587810:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1787856950.587835:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1787856950.588029:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1787856950.588053:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1787856950.588068:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1787856950.588098:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1787856950.588112:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1787856950.588125:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1787856950.588140:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1787856950.588153:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1787856950.588167:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1787856950.588180:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1787856950.588193:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1787856950.588206:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1787856950.588251:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1787856950.588267:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1787856950.588278:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1787856950.588289:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1787856950.588301:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1787856950.588312:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1787856950.588322:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1787856950.588345:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1787856950.588359:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1787856950.588372:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1787856950.588383:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1787856950.588394:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1787856950.588405:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1787856950.588416:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1787856950.588438:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1787856950.588451:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1787856950.588462:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1787856950.588473:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1787856950.588484:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1787856950.588495:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1787856950.588514:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1787856950.588525:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1787856950.588537:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1787856950.588557:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1787856950.588571:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1787856950.588584:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1787856950.588595:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1787856950.588606:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1787856950.590812:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856950.591612:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.591786:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d9cc53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.596928:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436403328 00000100:00100000:2.0:1787856950.596943:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436403328 00000100:00100000:2.0:1787856950.597007:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787856950.597017:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856950.597183:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403328:12345-0@lo:502:mount.lustre.0 Request processed in 167us (5573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.597202:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787856950.597791:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856950.598076:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1787856950.598112:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1787856950.598148:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856950.598198:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856950.598295:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436403456 00000100:00100000:2.0:1787856950.598301:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436403456 00000100:00100000:2.0:1787856950.598332:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787856950.598340:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856950.598414:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403456:12345-0@lo:502:mount.lustre.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.598421:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787856950.598837:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d9cc53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856950.598922:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856950.598967:0:17905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1787856950.598978:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787856950.601510:0:17924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787856950.601527:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9065c72d8000) 00000020:00000080:2.0:1787856950.601551:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787856950.601660:0:17924:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065fe85c800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787856950.601665:0:17924:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065fe85c800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787856950.601668:0:17924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065fe85c800 3 00010000:00080000:2.0:1787856950.601704:0:17924:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9065f71fd800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1787856950.605107:0:17924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787856950.611681:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787856950.611744:0:17924:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787856950.611760:0:17924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc25410d92a3c4d35 00000100:00080000:0.0:1787856950.611771:0:17924:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787856950.611777:0:17924:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9065f71fd800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856950.611812:0:17924:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c8241a40 x1874703436403584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787856950.611832:0:17924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787856950.611863:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856950.611868:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856950.611872:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856950.611875:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787856950.612213:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8241a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874703436403584:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787856950.612323:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856950.612381:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436403584 00000100:00100000:2.0:1787856950.612387:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436403584 00000100:00100000:2.0:1787856950.612421:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787856950.612427:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874703436403584:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787856950.612449:0:17175:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1787856950.612479:0:17175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc25410d92a3c4d3c 00000004:00100000:2.0:1787856950.612493:0:17175:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787856950.612521:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9065f71f8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856950.612581:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874703436403584:12345-0@lo:38:llog_process_th.0 Request processed in 153us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.612589:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787856950.612938:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9064c8241a40 x1874703436403584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856950.612949:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787856950.612956:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787856950.612964:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787856950.612968:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787856950.612970:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065f71fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787856950.612975:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8241a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874703436403584:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787856950.613168:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1787856950.619545:0:17905:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787856950.619596:0:17905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787856950.619640:0:17905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c4d20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d27 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.619653:0:17905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601939600/0xc25410d92a3c4d20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d27 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787856950.619714:0:17905:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787856950.619716:0:17905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787856950.619718:0:17905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856950.619719:0:17905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856950.619720:0:17905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856950.619722:0:17905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856950.619723:0:17905:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856950.619725:0:17905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856950.619726:0:17905:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787856950.619730:0:17905:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787856950.619733:0:17905:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787856950.619739:0:17905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787856950.619740:0:17905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787856950.619741:0:17905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787856950.619742:0:17905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787856950.619743:0:17905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787856950.619744:0:17905:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787856950.619745:0:17905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787856950.619746:0:17905:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787856950.619776:0:17905:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787856950.619799:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787856950.619868:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856950.620093:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436403712 00000100:00100000:2.0:1787856950.620100:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436403712 00000100:00100000:2.0:1787856950.620151:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787856950.620159:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403712:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787856950.620198:0:17168:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787856950.620213:0:17168:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787856950.621130:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37300 going to sleep for 11 seconds 00000001:00100000:2.0:1787856950.627703:0:17154:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787856950.627855:0:17168:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787856950.627874:0:17168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787856950.628206:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17905:x1874703436403712:12345-0@lo:253:mount.lustre.0 Request processed in 8043us (8333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.628237:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:2.0:1787856950.628321:0:17190:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787856950.628326:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787856950.628346:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.628360:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.628369:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.628377:0:17190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.628427:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.628441:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 17 pid: 17168 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856950.628455:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436403840:0@lo:104: 00000100:00100000:2.0:1787856950.628494:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787856950.628545:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856950.628554:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 17 pid: 17166 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856950.628562:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436403968:0@lo:104: 00000100:00100000:2.0:1787856950.628583:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856950.628602:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856950.632346:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17905:1874703436403712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787856950.632367:0:17905:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787856950.632370:0:17905:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787856950.632372:0:17905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787856950.632374:0:17905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856950.632375:0:17905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856950.632376:0:17905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856950.632377:0:17905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856950.632378:0:17905:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787856950.632380:0:17905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856950.632381:0:17905:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787856950.632397:0:17905:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787856950.635795:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436403840 00000100:00100000:0.0:1787856950.635809:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436403840 00000100:00100000:0.0:1787856950.635845:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436403968 00000100:00100000:0.0:1787856950.635847:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436403968 00000100:00100000:0.0:1787856950.635864:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856950.635874:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+4:17190:x1874703436403840:12345-0@lo:104: 00010000:00010000:0.0:1787856950.635893:0:17158:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.636015:0:17158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787856950.636021:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+4:17190:x1874703436403840:12345-0@lo:104: Request processed in 150us (7528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.636029:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856950.636048:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787856950.636055:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436403968:12345-0@lo:104: 00010000:00010000:0.0:1787856950.636063:0:17158:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.636095:0:17158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787856950.636099:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436403968:12345-0@lo:104: Request processed in 46us (7516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.636106:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787856950.638460:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856950.638471:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638481:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215bc00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856950.638485:0:17162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638494:0:17162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856950.638508:0:17162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856950.638513:0:17162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856950.638560:0:17162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638567:0:17162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856950.638591:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638598:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c4d04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d0b expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638611:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856950.638623:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638629:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb400 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:1.0:1787856950.638632:0:17162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638663:0:17162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856950.638670:0:17162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856950.638674:0:17162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856950.638696:0:17162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638702:0:17162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856950.638717:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638723:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9066007bb400/0xc25410d92a3c4c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c47 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.638735:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856950.638737:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856950.638739:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856950.638776:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436404096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856950.638834:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.638887:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436404224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856950.638910:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.638957:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436404096 00000100:00100000:1.0:1787856950.638962:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436404096 00010000:00010000:1.0:1787856950.638989:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 18 pid: 17168 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856950.639011:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436404224 00000100:00100000:1.0:1787856950.639014:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436404224 00010000:00010000:1.0:1787856950.639024:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 19 pid: 17166 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856950.639036:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856950.639043:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:3624:x1874703436404096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856950.639054:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856950.639064:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 19 pid: 17168 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639075:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 19 pid: 17168 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639092:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856950.639123:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:3624:x1874703436404096:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856950.639130:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856950.639147:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856950.639153:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3625:x1874703436404224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856950.639160:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856950.639165:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 18 pid: 17166 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639172:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 18 pid: 17166 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639184:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639193:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787856950.639207:0:17159:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010881612s 00010000:00010000:1.0:1787856950.639212:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639246:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639264:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639270:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639276:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856950.639280:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639287:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639295:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639305:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856950.639333:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3625:x1874703436404224:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856950.639340:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856950.639376:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436404096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856950.639398:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436404224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856950.639420:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065c13c9e00/0xc25410d92a3c4d0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4d04 expref: 17 pid: 17168 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856950.639432:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436403840:0@lo:104: 00010000:00010000:1.0:1787856950.639442:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660215ae00/0xc25410d92a3c4c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4c40 expref: 16 pid: 17166 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856950.639458:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436403968:0@lo:104: 00010000:00010000:1.0:1787856950.639477:0:17190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639486:0:17190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639493:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856950.639499:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660215b000/0xc25410d92a3c4d43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856950.641050:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787856950.650214:0:17905:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787856950.650473:0:17931:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787856950.650478:0:17931:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787856950.650542:0:17932:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1787856950.651026:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787856950.655504:0:17905:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1787856950.656170:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787856950.657047:0:17932:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1787856950.657816:0:17905:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787856950.657853:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856950.658331:0:17933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1874703436404352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787856950.658408:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856950.658443:0:17933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f71d9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.658515:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436404352 00000100:00100000:2.0:1787856950.658522:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436404352 00000100:00100000:2.0:1787856950.658578:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856950.658587:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17933:x1874703436404352:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787856950.658898:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17933:x1874703436404352:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 312us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.658906:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00000080:0.0:1787856950.659311:0:17905:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787856950.659322:0:17905:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787856950.659400:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787856950.661191:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787856950.662069:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787856950.662109:0:17905:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1787856950.662375:0:17933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1874703436404352:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787856950.662507:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787856950.663360:0:17905:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:01000000:1.0:1787856950.665391:0:17933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787856950.665443:0:17933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1874703436404480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787856950.665511:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:0.0:1787856950.665818:0:17905:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787856950.666003:0:17933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760780 going to sleep for 11 seconds 00000100:00100000:2.0:1787856950.666050:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436404480 00000100:00100000:2.0:1787856950.666066:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436404480 00000100:00100000:2.0:1787856950.666148:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787856950.666157:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17933:x1874703436404480:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787856950.666353:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17933:x1874703436404480:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 197us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856950.666361:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856950.666436:0:17933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1874703436404480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787856950.666503:0:17933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17933:1874703436404608:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787856950.666601:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856950.666658:0:17933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787856950.666935:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436404608 00000100:00100000:0.0:1787856950.666945:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436404608 00000100:00100000:0.0:1787856950.666974:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787856950.666981:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17933:x1874703436404608:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787856950.667024:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17933:x1874703436404608:12345-0@lo:900:lod0001_rec0000.0 Request processed in 44us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856950.667031:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787856950.667154:0:17933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff906601a3f0c0 x1874703436404608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787856966 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856950.667165:0:17933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17933:1874703436404608:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787856950.667210:0:17933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1874703436404736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787856950.667675:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856950.667702:0:17933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787856950.667791:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436404736 00000100:00100000:1.0:1787856950.667796:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436404736 00000100:00100000:1.0:1787856950.667831:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787856950.667839:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17933:x1874703436404736:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787856950.667905:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17933:x1874703436404736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856950.667912:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856950.668051:0:17933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f0c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1874703436404736:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787856950.668093:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856950.670407:0:17933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787856950.670487:0:17933:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787856950.670493:0:17933:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1787856950.676943:0:17905:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787856950.676981:0:17905:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae99c553f988 00100000:10000000:0.0:1787856950.676989:0:17905:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787856950.680038:0:17905:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787856950.680073:0:17905:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787856950.680090:0:17905:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787856950.680108:0:17905:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787856950.681913:0:17905:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787856950.682114:0:17905:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787856951.000502:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856951.514328:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00000040:00080000:3.0:1787856951.661940:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787856952.022573:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787856952.082303:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787856952.082311:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065fe85c800 from 8 10000000:01000000:2.0:1787856952.082317:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787856952.082376:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856952.082389:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856952.082399:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856952.082425:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436404864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787856952.082491:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856952.082563:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440300 going to sleep for 11 seconds 00000100:00100000:3.0:1787856952.082816:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436404864 00000100:00100000:3.0:1787856952.082824:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436404864 00000100:00100000:3.0:1787856952.082895:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787856952.082904:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:17170:x1874703436404864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856952.082916:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856952.082941:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4d4a expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856952.082964:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856952.082973:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856952.082995:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe000, rc 0) 00000100:00100000:3.0:1787856952.083049:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436404864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856952.083056:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787856952.083204:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436404864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856952.083258:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856952.083267:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856952.083321:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436404992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787856952.083368:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856952.083391:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856952.083578:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436404992 00000100:00100000:2.0:1787856952.083582:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436404992 00000100:00100000:2.0:1787856952.083636:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787856952.083644:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436404992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787856952.083661:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787856952.083677:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787856952.083679:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787856952.083758:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436404992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856952.083765:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787856952.083959:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436404992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787856952.084005:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787856952.084013:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856952.084021:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856952.084032:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787856952.084034:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065c52b7000 from 8 10000000:01000000:1.0:1787856952.084036:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787856952.084054:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856952.084061:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856952.084068:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856952.084089:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436405120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856952.084115:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856952.084141:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856952.084283:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436405120 00000100:00100000:2.0:1787856952.084288:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436405120 00000100:00100000:2.0:1787856952.084310:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787856952.084316:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436405120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856952.084323:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856952.084403:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4d58 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856952.084422:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856952.084430:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856952.084438:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215b800, rc 0) 00000100:00100000:2.0:1787856952.084465:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17170:x1874703436405120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856952.084472:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856952.084712:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436405120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856952.084725:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856952.084734:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856952.084777:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436405248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787856952.084804:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856952.084833:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856952.085079:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436405248 00000100:00100000:2.0:1787856952.085084:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436405248 00000100:00100000:2.0:1787856952.087227:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787856952.087250:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17170:x1874703436405248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787856952.087276:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787856952.087298:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787856952.087302:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787856952.087443:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17170:x1874703436405248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 203us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856952.087457:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787856952.087595:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436405248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787856952.087671:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787856952.087681:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856952.087693:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856952.530252:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00000040:00080000:3.0:1787856952.722080:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787856953.042975:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856953.555600:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:0.0:1787856954.078718:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856954.580675:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00010000:00010000:0.0:1787856955.090068:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856955.605615:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 0 seconds 00000001:02000400:2.0:1787856955.691697:0:18176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787856955.736016:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856955.736046:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436405376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856955.736139:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856955.736188:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436405376 00000100:00100000:3.0:1787856955.736197:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436405376 00000100:00100000:3.0:1787856955.736273:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787856955.736282:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436405376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856955.736401:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787856955.736456:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436405376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856955.736464:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787856955.736666:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436405376:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787856955.738086:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787856955.738091:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787856955.738095:0:8:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787856955.738106:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9066018a2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856955.738132:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c826d680 x1874703436405632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787856955.738150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787856955.738154:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787856955.738157:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787856955.738160:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787856955.738171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787856955.738174:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787856955.738177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787856955.738179:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787856955.738236:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436405760:0@lo:400:kworker.0 00000100:00100000:2.0:1787856955.738301:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856955.738358:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856955.738365:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436405504:0@lo:400:kworker.0 00000100:00100000:2.0:1787856955.738602:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856955.738678:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436405632:0@lo:38:kworker.0 00000100:00100000:2.0:1787856955.738705:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856955.738738:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436405760 00000100:00100000:2.0:1787856955.738745:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436405760 00000100:00100000:2.0:1787856955.738789:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856955.738797:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436405760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856955.738924:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436405760:12345-0@lo:400:kworker.0 Request processed in 127us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856955.738930:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856955.738951:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436405632 00000100:00100000:2.0:1787856955.738954:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436405632 00000100:00100000:2.0:1787856955.738974:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787856955.738979:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874703436405632:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787856955.739003:0:17914:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1787856955.739041:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c4d66 00000004:00100000:2.0:1787856955.739058:0:17914:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787856955.739065:0:17914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787856955.739156:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856955.739166:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436405888:0@lo:400:kworker.0 00000100:00100000:2.0:1787856955.739192:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787856955.739251:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c826c000 x1874703436405760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856955.739265:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436405760:0@lo:400:kworker.0 00000100:00100000:1.0:1787856955.740560:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436405888 00000100:00100000:1.0:1787856955.740568:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436405888 00000100:00100000:1.0:1787856955.741700:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856955.741715:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436405888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856955.741818:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436405888:12345-0@lo:400:kworker.0 Request processed in 107us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856955.741826:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787856955.742257:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436405504 00000100:00100000:0.0:1787856955.742266:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436405504 00000100:00100000:0.0:1787856955.742325:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787856955.742332:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3624:x1874703436405504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856955.742384:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3624:x1874703436405504:12345-0@lo:400:kworker.0 Request processed in 53us (3782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856955.742390:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787856955.742462:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436405504:0@lo:400:kworker.0 00010000:00080000:1.0:1787856955.742740:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c826cb40 x1874703436405888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856955.742754:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436405888:0@lo:400:kworker.0 00000100:00080000:0.0:1787856955.749351:0:17914:0:(import.c:65:import_set_state_nolock()) ffff9065dfae5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856955.751165:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874703436405632:12345-0@lo:38:kworker.0 Request processed in 12175us (12448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856955.751183:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787856955.751644:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787856955.751654:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787856955.751660:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787856955.751665:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066018a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787856955.751688:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000eaba7de0): req@ffff906601a3d680 x1874703436398208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856955.751707:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436405632:0@lo:38:kworker.0 00000100:00100000:1.0:1787856955.751758:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436406016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856955.751798:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856955.752984:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436398208 00000100:00100000:1.0:1787856955.752996:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436398208 00000100:00100000:1.0:1787856955.753049:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787856955.753059:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17215:x1874703436398208:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787856955.753125:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787856955.753153:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856955.753158:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17215:x1874703436398208:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 102us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856955.753166:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787856955.753179:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436406016 00000100:00100000:1.0:1787856955.753182:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436406016 00000100:00100000:3.0:1787856955.753195:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3d680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874703436398208:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787856955.753195:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787856955.753200:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436406016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856955.753237:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000040:01000000:3.0:1787856955.753245:0:17215:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787856955.753275:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1874703436406016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856955.753280:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856955.753284:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3d680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874703436406144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787856955.755326:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856955.755367:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fe9c3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787856955.755414:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436406016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856955.755441:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436406144 00000100:00100000:3.0:1787856955.755446:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436406144 00000100:00100000:3.0:1787856955.755476:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856955.755482:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17215:x1874703436406144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787856955.755629:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17215:x1874703436406144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 145us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856955.755636:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787856955.756247:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3d680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874703436406144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787856955.756350:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874703436406272:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787856955.756384:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856955.756406:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378600 going to sleep for 11 seconds 00000100:00100000:3.0:1787856955.756732:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436406272 00000100:00100000:3.0:1787856955.756739:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436406272 00000100:00100000:3.0:1787856955.759362:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787856955.759384:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17215:x1874703436406272:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787856955.759522:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17215:x1874703436406272:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 147us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856955.759529:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787856955.761596:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17215:1874703436406272:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787856955.761676:0:17215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856955.786887:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787856955.786972:0:17215:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:3.0:1787856955.786977:0:17215:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787856956.113890:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787856956.570803:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787856956.945727:0:18228:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787856956.945963:0:18228:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787856957.140839:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787856958.132416:0:18278:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856958.133047:0:18278:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787856958.165172:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856958.801719:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856943/real 1787856943] req@ffff906601a3da40 x1874703436399232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856958.801764:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff906601a3da40 x1874703436399232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856958.801787:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856943/real 1787856943] req@ffff906601a3de00 x1874703436399360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856958.801801:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff906601a3de00 x1874703436399360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787856958.801831:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065c8dae800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856958.801858:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787856958.801864:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436399232:0@lo:8:kworker.0 00000100:00080000:2.0:1787856958.801870:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856958.801876:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787856958.801880:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436399360:0@lo:8:kworker.0 00000100:00080000:3.0:1787856958.802088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856958.802094:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787856958.802098:0:8:0:(import.c:65:import_set_state_nolock()) ffff9065c8dae800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856958.802106:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1787856958.802112:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787856958.802120:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9065c8dae800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856958.802145:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3c3c0 x1874703436406656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856958.802160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856958.802163:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787856958.802165:0:8:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856958.802168:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1787856958.802172:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787856958.802175:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9066007b3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856958.802186:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3f840 x1874703436406784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856958.802253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856958.802256:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856958.802259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856958.802263:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787856958.802294:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436406528:0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.802390:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856958.802464:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787856958.802471:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436406400:0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.802503:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856958.802525:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436407168:0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.802574:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856958.802603:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436406912:0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.802628:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856958.802646:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856958.802651:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436407040:0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.802673:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856958.802711:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436406528 00000100:00100000:3.0:1787856958.802721:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436406528 00000100:00100000:3.0:1787856958.802768:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436407040 00000100:00100000:3.0:1787856958.802771:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436407040 00000100:00100000:3.0:1787856958.802804:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787856958.802814:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436406528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.802881:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436406528:12345-0@lo:400:kworker.0 Request processed in 67us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856958.802889:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787856958.802909:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787856958.802915:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436407040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.802948:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436407040:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856958.802953:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787856958.802973:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436406400 00000100:00100000:3.0:1787856958.802977:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436406400 00000100:00100000:3.0:1787856958.803008:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787856958.803024:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3624:x1874703436406400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.803057:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3624:x1874703436406400:12345-0@lo:400:kworker.0 Request processed in 35us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856958.803064:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787856958.803097:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436407168 00000100:00100000:3.0:1787856958.803102:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436407168 00000100:00100000:3.0:1787856958.803129:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436406912 00000100:00100000:3.0:1787856958.803132:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436406912 00000100:00100000:3.0:1787856958.803146:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856958.803152:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436407168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.803182:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436407168:12345-0@lo:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856958.803188:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856958.803199:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856958.803205:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436406912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.803268:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436406912:12345-0@lo:400:kworker.0 Request processed in 63us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856958.803274:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856958.803329:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436407040:0@lo:400:kworker.0 00010000:00080000:3.0:1787856958.803342:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff906601a3c780 x1874703436406912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856958.803352:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436406912:0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.803380:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436406656:0@lo:8:kworker.0 00000400:00000100:3.0:1787856958.803409:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436406656 offset 0 length 520: 4 00000100:00100000:3.0:1787856958.803431:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436406784:0@lo:8:kworker.0 00000400:00000100:3.0:1787856958.803463:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436406784 offset 0 length 520: 4 00000100:00100000:3.0:1787856958.803497:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436406400:0@lo:400:kworker.0 00010000:00080000:3.0:1787856958.803509:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff906601a3cb40 x1874703436407168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856958.803517:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436407168:0@lo:400:kworker.0 00000100:00100000:3.0:1787856958.803527:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436406528:0@lo:400:kworker.0 00010000:00010000:0.0:1787856959.186040:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787856959.781977:0:18327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb139a040 20000000:00000080:0.0:1787856959.782000:0:18327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9065df840800 uarg=0000000000000000 20000000:01000000:0.0:1787856959.782056:0:18327:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787856959.782065:0:18327:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787856959.782071:0:18327:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787856959.783860:0:18328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787856959.791772:0:18327:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787856959.800504:0:18327:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787856959.800817:0:18327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.800846:0:18327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.800854:0:18327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.800863:0:18327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.800927:0:18327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.800962:0:18327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 17 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856959.800982:0:18327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18327:1874703436407296:0@lo:104: 00000100:00100000:1.0:1787856959.801075:0:18327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856959.801280:0:18327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 17 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.801290:0:18327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 17 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856959.801303:0:18327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18327:1874703436407424:0@lo:104: 00000100:00100000:1.0:1787856959.801345:0:18327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856959.805802:0:18327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856959.805933:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436407296 00000100:00100000:2.0:1787856959.805946:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436407296 00000100:00100000:2.0:1787856959.806007:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436407424 00000100:00100000:2.0:1787856959.806011:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436407424 00000100:00100000:2.0:1787856959.806031:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856959.806041:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+4:18327:x1874703436407296:12345-0@lo:104: 00010000:00010000:2.0:1787856959.806065:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856959.806252:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787856959.806259:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+4:18327:x1874703436407296:12345-0@lo:104: Request processed in 220us (5184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856959.806268:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856959.806291:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856959.806298:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:18327:x1874703436407424:12345-0@lo:104: 00010000:00010000:2.0:1787856959.806307:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856959.807259:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856959.807272:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856959.807283:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938800 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:3.0:1787856959.807289:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856959.807300:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856959.807308:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856959.807315:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787856959.807387:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856959.807394:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787856959.807420:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856959.807447:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c4d12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d19 expref: -99 pid: 17905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856959.807467:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856959.807469:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856959.807471:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856959.807491:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436407552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856959.811843:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856959.813703:0:18327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18327:1874703436407296:0@lo:104: 00000100:00100000:0.0:1787856959.813867:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436407552 00000100:00100000:0.0:1787856959.813876:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436407552 00010000:00010000:0.0:1787856959.813920:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 18 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856959.813977:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856959.813988:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3624:x1874703436407552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856959.814007:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856959.814013:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 18 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856959.814026:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 18 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856959.814050:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5fe600/0xc25410d92a3c4d19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4d12 expref: 18 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856959.814069:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856959.814157:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:3624:x1874703436407552:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856959.814164:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856959.814267:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436407552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856959.822828:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787856959.822853:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:18327:x1874703436407424:12345-0@lo:104: Request processed in 16549us (21500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856959.822869:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856959.823001:0:18327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18327:1874703436407424:0@lo:104: 00010000:00010000:1.0:1787856959.823049:0:18327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856959.823113:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856959.823124:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856959.823133:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a200 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856959.823139:0:17162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856959.823150:0:17162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856959.823158:0:17162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856959.823165:0:17162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787856959.823273:0:17162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856959.823281:0:17162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856959.823333:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856959.823342:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660215a200/0xc25410d92a3c4c0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4c16 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856959.823361:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856959.823363:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856959.823365:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856959.823787:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436407680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856959.823854:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856959.823974:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436407680 00000100:00100000:1.0:1787856959.823982:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436407680 00010000:00010000:1.0:1787856959.824018:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 17 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856959.824061:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856959.824072:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:3625:x1874703436407680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856959.824088:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856959.824101:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 17 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824114:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 17 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824131:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9066007bbe00/0xc25410d92a3c4c16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4c0f expref: 17 pid: 17168 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824158:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824168:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824185:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824194:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824202:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824209:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824246:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939400 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856959.824251:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824261:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824285:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856959.824295:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856959.824345:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:3625:x1874703436407680:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856959.824353:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787856959.824610:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436407680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856959.824639:0:18327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856959.824647:0:18327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856959.824653:0:18327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906601939400/0xc25410d92a3c4d6d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856960.209414:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856960.849628:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856950/real 1787856950] req@ffff9064c83f9680 x1874703436401792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856960.849656:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c83f9680 x1874703436401792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856960.849667:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856950/real 1787856950] req@ffff9064c8242940 x1874703436401664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856960.849679:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c8242940 x1874703436401664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787856960.849698:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856960.849723:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787856960.849728:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436401792:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787856960.849734:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065eb5d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856960.849739:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787856960.849742:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436401664:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787856960.849838:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856960.849842:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856960.849845:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856960.849849:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856960.849863:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856960.849866:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787856960.849869:0:38:0:(import.c:65:import_set_state_nolock()) ffff9065eb5d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787856960.849874:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 484 00000100:00080000:0.0:1787856960.849879:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787856960.849885:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9065eb5d8800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856960.849904:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c8240f00 x1874703436408320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787856960.849916:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856960.849919:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787856960.849921:0:38:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787856960.849924:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 484 00000100:00080000:0.0:1787856960.849927:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787856960.849930:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9064c8172000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856960.849947:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c8241a40 x1874703436408448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787856960.849978:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3626:1874703436407808:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.850040:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856960.850075:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8243840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436408576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.850104:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856960.850125:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787856960.850130:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8242d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436408192:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.850154:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856960.850183:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436407936:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.850204:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856960.850400:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856960.850407:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436408064:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.850430:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856960.850466:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436407808 00000100:00100000:0.0:1787856960.850474:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436407808 00000100:00100000:0.0:1787856960.850609:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787856960.850620:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:3626:x1874703436407808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.850668:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:3626:x1874703436407808:12345-0@lo:400:kworker.0 Request processed in 50us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856960.850676:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787856960.850711:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436408576 00000100:00100000:0.0:1787856960.850715:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436408576 00000100:00100000:0.0:1787856960.850738:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436408064 00000100:00100000:0.0:1787856960.850740:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436408064 00000100:00100000:0.0:1787856960.851351:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787856960.851364:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436408576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.851415:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436408576:12345-0@lo:400:kworker.0 Request processed in 57us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856960.851422:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787856960.851439:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787856960.851446:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8241e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436408064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.851480:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8241e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436408064:12345-0@lo:400:kworker.0 Request processed in 35us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856960.851487:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787856960.851509:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436408192 00000100:00100000:0.0:1787856960.851513:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436408192 00000100:00100000:2.0:1787856960.851689:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856960.851700:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436408704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856960.851731:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856960.851769:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436407936 00000100:00100000:2.0:1787856960.851773:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436407936 00000100:00100000:2.0:1787856960.851792:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436408704 00000100:00100000:2.0:1787856960.851794:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436408704 00000100:00100000:2.0:1787856960.851804:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787856960.851809:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436407936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856960.851842:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436407936:12345-0@lo:400:kworker.0 Request processed in 32us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856960.851848:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787856960.851860:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787856960.851865:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1874703436408704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856960.851888:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787856960.851925:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1874703436408704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856960.851931:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787856960.851969:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436408704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856960.852134:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856960.852141:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436408192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.852173:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436408192:12345-0@lo:400:kworker.0 Request processed in 33us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856960.852180:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787856960.852408:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c82403c0 x1874703436408064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856960.852421:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436408064:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.852437:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436407936:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.852463:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436408320:0@lo:8:kworker.0 00000400:00000100:0.0:1787856960.852488:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436408320 offset 0 length 520: 4 00000100:00100000:0.0:1787856960.852512:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8241a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436408448:0@lo:8:kworker.0 00000400:00000100:0.0:1787856960.852616:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703436408448 offset 0 length 520: 4 00000100:00100000:0.0:1787856960.852651:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8242d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436408192:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.852671:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3626:1874703436407808:0@lo:400:kworker.0 00010000:00080000:0.0:1787856960.852682:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c8243840 x1874703436408576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856960.852693:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8243840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436408576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856960.854657:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856960.862138:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436408832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856960.862427:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856960.862556:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436408832 00000100:00100000:3.0:1787856960.862565:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436408832 00000100:00100000:3.0:1787856960.862617:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787856960.862626:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436408832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787856960.862662:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787856960.862725:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436408832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856960.862732:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787856960.862946:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436408832:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1787856961.041435:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856961.041443:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe85c800 from 13 10000000:01000000:1.0:1787856961.041449:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856961.041499:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.041511:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.041663:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856961.041693:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436408960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856961.041778:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856961.041888:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856961.045664:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436408960 00000100:00100000:3.0:1787856961.045680:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436408960 00000100:00100000:2.0:1787856961.049746:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787856961.049769:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+16:17170:x1874703436408960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856961.049787:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856961.049808:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4d74 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856961.049838:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856961.049849:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856961.049857:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215a200, rc 0) 00000100:00100000:2.0:1787856961.049945:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436408960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (8166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856961.049952:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787856961.050048:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436408960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856961.050067:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.050076:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856961.050172:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856961.050206:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856961.058790:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856961.065668:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436409088 00000100:00100000:0.0:1787856961.065684:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436409088 00000100:00100000:0.0:1787856961.065764:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787856961.065776:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436409088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856961.065952:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436409088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (15745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856961.065959:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787856961.067435:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856961.067499:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856961.067649:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856961.067695:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856961.068408:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436409216 00000100:00100000:3.0:1787856961.068415:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436409216 00000100:00100000:3.0:1787856961.068529:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787856961.068548:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436409216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856961.073502:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436409216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4953us (5842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856961.073528:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787856961.081669:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787856961.087724:0:18359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787856961.089630:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787856961.089660:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787856961.089671:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.089683:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856961.089693:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787856961.089696:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065c52b7000 from 13 10000000:01000000:1.0:1787856961.089699:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856961.089732:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.089739:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.089750:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856961.089856:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856961.089926:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856961.090032:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb760f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856961.100450:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436409344 00000100:00100000:0.0:1787856961.100463:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436409344 00000100:00100000:1.0:1787856961.110817:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787856961.110830:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+17:17170:x1874703436409344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856961.110848:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856961.110867:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4d82 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.110897:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.110909:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.110919:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939c00, rc 0) 00000100:00100000:1.0:1787856961.111005:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17170:x1874703436409344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (21078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856961.111013:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787856961.111096:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856961.111116:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856961.111125:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856961.111240:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856961.111291:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856961.123729:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856961.124095:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436409472 00000100:00100000:0.0:1787856961.124104:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436409472 00000100:00100000:0.0:1787856961.124152:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787856961.124159:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17170:x1874703436409472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856961.124369:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17170:x1874703436409472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (13078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856961.124374:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787856961.127391:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856961.127463:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856961.127614:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856961.127652:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436409600 00000100:00100000:2.0:1787856961.127656:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436409600 00000100:00100000:2.0:1787856961.127687:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787856961.127692:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17170:x1874703436409600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856961.130694:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:17170:x1874703436409600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2993us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856961.130709:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787856961.130768:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856961.130790:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436409600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787856961.139180:0:18363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787856961.140448:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787856961.140478:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787856961.140494:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856961.140505:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856961.235359:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787856961.365679:0:17906:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787856962.264082:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787856962.965327:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787856963.284057:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856964.307031:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856965.343615:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787856965.974002:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856965.974020:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856965.974023:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856965.974026:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856965.974054:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856965.974057:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856965.974060:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856965.974063:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787856965.974128:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436409728:0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.974249:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856965.974312:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436410240:0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.974342:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856965.974372:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856965.974379:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436409856:0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.974407:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856965.974439:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436409984:0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.974464:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856965.974500:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856965.974507:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c82430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436410112:0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.974532:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856965.974582:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436409728 00000100:00100000:0.0:1787856965.974592:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436409728 00000100:00100000:0.0:1787856965.974649:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787856965.974660:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3625:x1874703436409728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.974721:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:3625:x1874703436409728:12345-0@lo:400:kworker.0 Request processed in 63us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856965.974730:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787856965.974770:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436410240 00000100:00100000:0.0:1787856965.974774:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436410240 00000100:00100000:0.0:1787856965.974802:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436409984 00000100:00100000:0.0:1787856965.974805:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436409984 00000100:00100000:0.0:1787856965.974820:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787856965.974826:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436410240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.974860:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874703436410240:12345-0@lo:400:kworker.0 Request processed in 33us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856965.974866:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787856965.974878:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856965.974883:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436409984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.974911:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436409984:12345-0@lo:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856965.974917:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856965.974935:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436409856 00000100:00100000:0.0:1787856965.974938:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436409856 00000100:00100000:0.0:1787856965.974958:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436410112 00000100:00100000:0.0:1787856965.974960:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436410112 00000100:00100000:0.0:1787856965.974984:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787856965.974989:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436409856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.975022:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436409856:12345-0@lo:400:kworker.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856965.975028:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787856965.975039:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787856965.975044:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436410112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.975068:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436410112:12345-0@lo:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856965.975073:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787856965.975119:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436409856:0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.975127:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436409728:0@lo:400:kworker.0 00010000:00080000:0.0:1787856965.975139:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c8242940 x1874703436410240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856965.975149:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874703436410240:0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.975186:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c82430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436410112:0@lo:400:kworker.0 00010000:00080000:0.0:1787856965.975195:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c8240b40 x1874703436409984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856965.975203:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436409984:0@lo:400:kworker.0 00000100:00100000:0.0:1787856965.977832:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436410368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856965.977927:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856965.978127:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436410496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856965.978159:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856965.978284:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436410368 00000100:00100000:0.0:1787856965.978293:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436410368 00000100:00100000:0.0:1787856965.978338:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436410496 00000100:00100000:0.0:1787856965.978341:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436410496 00000100:00100000:0.0:1787856965.978357:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787856965.978365:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436410368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856965.978410:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787856965.978462:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436410368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856965.978471:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787856965.978502:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856965.978508:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436410496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787856965.978527:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787856965.978856:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436410496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 348us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856965.978864:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856965.978918:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436410368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856965.979482:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436410496:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787856966.355589:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787856966.808453:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787856967.382821:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787856967.704088:0:18676:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787856967.704094:0:18676:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787856967.704096:0:18676:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787856967.704271:0:18676:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9065dfae1800 00000020:01000004:0.0:1787856967.704294:0:18676:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787856967.704312:0:18676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787856967.704330:0:18676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9065e9fd19d0) 00000020:00000080:0.0:1787856967.704353:0:18676:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787856967.848517:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787856967.857469:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787856967.858202:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787856967.858518:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787856967.859012:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787856967.859213:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787856967.859414:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1787856967.861090:0:18676:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787856967.861400:0:18676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787856967.861414:0:18676:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787856967.861427:0:18676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc25410d92a3c4d97 00000020:01000004:2.0:1787856967.861434:0:18676:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787856967.861745:0:18676:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787856967.861749:0:18676:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787856967.861756:0:18676:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787856967.861760:0:18676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787856967.861773:0:18676:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9065c72d99d0) 00000020:00000080:2.0:1787856967.861784:0:18676:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787856967.863334:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787856967.864261:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787856967.864269:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787856967.867363:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787856967.867382:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787856967.867862:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787856967.867870:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787856967.872785:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787856967.873045:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787856967.873053:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787856967.875480:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787856967.875500:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787856967.909022:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787856967.909607:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787856967.909615:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787856967.914135:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787856967.914152:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787856967.919730:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787856967.919747:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787856967.926875:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787856967.927079:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787856967.927086:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787856967.927810:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787856967.927823:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787856967.981592:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787856967.981901:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787856967.981908:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787856967.983663:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787856967.983675:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787856967.984181:0:18676:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787856967.984248:0:18676:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787856967.984255:0:18676:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787856968.021907:0:18676:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787856968.021968:0:18676:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787856968.021973:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787856968.021975:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787856968.021977:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856968.021978:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856968.021979:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856968.021981:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856968.021983:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856968.021986:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856968.021987:0:18676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787856968.021993:0:18676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787856968.021996:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787856968.021997:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787856968.021999:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856968.022000:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856968.022001:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856968.022002:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856968.022003:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856968.022004:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856968.022006:0:18676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787856968.022043:0:18676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787856968.022071:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436410624:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787856968.022186:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.022276:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f5c30600 going to sleep for 11 seconds 00000100:00100000:3.0:1787856968.022467:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436410624 00000100:00100000:3.0:1787856968.022483:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436410624 00000100:00100000:3.0:1787856968.022559:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787856968.022570:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:18676:x1874703436410624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787856968.022611:0:17168:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787856968.022615:0:17168:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787856968.022620:0:17168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787856968.023497:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:18676:x1874703436410624:12345-0@lo:253:mount.lustre.0 Request processed in 901us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856968.023511:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787856968.029536:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436410624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787856968.029562:0:18676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787856968.029566:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787856968.029567:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787856968.029569:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856968.029570:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856968.029571:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856968.029572:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856968.029574:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856968.029575:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856968.029593:0:18676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787856968.029644:0:18676:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9065dfae1800 from lustre-OST0000 10000000:01000000:1.0:1787856968.029681:0:18676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787856968.029684:0:18676:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787856968.029694:0:18676:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9065fe710000 local copy 00010000:00010000:1.0:1787856968.029706:0:18676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856968.029812:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436410752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856968.029955:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.030064:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f5c30780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856968.030746:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436410752 00000100:00100000:0.0:1787856968.030761:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436410752 00000100:00100000:0.0:1787856968.030852:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787856968.030865:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:18676:x1874703436410752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856968.031021:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:18676:x1874703436410752:12345-0@lo:501:mount.lustre.0 Request processed in 158us (1066us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787856968.031029:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787856968.031105:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436410752:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787856968.031396:0:18676:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787856968.031437:0:18676:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787856968.031447:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856968.031460:0:18676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856968.031516:0:18676:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9065dfae1800 10000000:01000000:0.0:1787856968.031522:0:18676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787856968.031530:0:18676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787856968.031533:0:18676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787856968.031538:0:18676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787856968.031542:0:18676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787856968.031583:0:18676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007ba200/0xc25410d92a3c4da5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856968.031614:0:18676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9066007ba200/0xc25410d92a3c4da5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856968.031625:0:18676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9066007ba200/0xc25410d92a3c4da5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856968.031650:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436410880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787856968.031748:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.031790:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440300 going to sleep for 11 seconds 00000100:00100000:3.0:1787856968.031830:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436410880 00000100:00100000:3.0:1787856968.031839:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436410880 00000100:00100000:3.0:1787856968.031972:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787856968.031982:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+18:18676:x1874703436410880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856968.032008:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856968.032038:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c4dac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4da5 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.032065:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c4dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4da5 expref: 19 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.032078:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ff000/0xc25410d92a3c4dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4da5 expref: 19 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.032088:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff000, rc 0) 00000100:00100000:3.0:1787856968.032690:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436410880:12345-0@lo:101:mount.lustre.0 Request processed in 708us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856968.032699:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787856968.033344:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436410880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787856968.033382:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9066007ba200/0xc25410d92a3c4da5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dac expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856968.033397:0:18676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9066007ba200/0xc25410d92a3c4da5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4dac expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787856968.035117:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787856968.041037:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787856968.048420:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787856968.049905:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787856968.049962:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787856968.049976:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787856968.049992:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787856968.050005:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787856968.050041:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787856968.050047:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787856968.050257:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856968.050352:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.050435:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856968.051498:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436411008 00000100:00100000:2.0:1787856968.051512:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436411008 00000100:00100000:2.0:1787856968.051595:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787856968.051607:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856968.052063:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411008:12345-0@lo:501:mount.lustre.0 Request processed in 455us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856968.052072:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787856968.052956:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856968.053029:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787856968.053117:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.053346:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440000 going to sleep for 11 seconds 00000100:00100000:3.0:1787856968.053423:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436411136 00000100:00100000:3.0:1787856968.053431:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436411136 00000100:00100000:3.0:1787856968.053540:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787856968.053552:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787856968.054774:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411136:12345-0@lo:503:mount.lustre.0 Request processed in 1212us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856968.054792:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787856968.054985:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787856968.056453:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787856968.056587:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856968.057991:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.059512:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440300 going to sleep for 11 seconds 00000100:00100000:1.0:1787856968.062079:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436411264 00000100:00100000:1.0:1787856968.062096:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436411264 00000100:00100000:1.0:1787856968.062175:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787856968.062183:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856968.065930:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411264:12345-0@lo:502:mount.lustre.0 Request processed in 3616us (7816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856968.065951:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787856968.066124:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787856968.066507:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787856968.066549:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787856968.066565:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787856968.066578:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787856968.066591:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787856968.066628:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787856968.066645:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787856968.066659:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787856968.066674:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787856968.066700:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787856968.066717:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787856968.066730:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787856968.066777:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856968.066969:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.067010:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440300 going to sleep for 11 seconds 00000100:00100000:1.0:1787856968.067328:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436411392 00000100:00100000:1.0:1787856968.067338:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436411392 00000100:00100000:1.0:1787856968.067390:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787856968.067400:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856968.067560:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411392:12345-0@lo:502:mount.lustre.0 Request processed in 161us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856968.067569:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787856968.067938:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787856968.068027:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787856968.068041:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787856968.069589:0:18693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787856968.069605:0:18693:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787856968.069614:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856968.069618:0:18693:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787856968.069628:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787856968.069650:0:18693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9064c5d999d0) 00000020:00000080:0.0:1787856968.069683:0:18693:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787856968.069700:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787856968.070043:0:18693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065dfae1800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787856968.070055:0:18693:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787856968.070066:0:18693:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc25410d92a3c4dba 00010000:00010000:2.0:1787856968.078249:0:18693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787856968.079560:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1787856968.091375:0:18693:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1787856968.110973:0:18693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787856968.110997:0:18693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856968.111011:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.111014:0:18693:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787856968.111019:0:18693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787856968.111023:0:18693:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787856968.111025:0:18693:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787856968.111027:0:18693:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787856968.111028:0:18693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787856968.111053:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.111054:0:18693:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787856968.111058:0:18693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856968.111062:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.111063:0:18693:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787856968.111068:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787856968.111070:0:18693:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787856968.111073:0:18693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856968.111075:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.111077:0:18693:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787856968.111079:0:18693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856968.111081:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.111083:0:18693:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787856968.111087:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787856968.111136:0:18693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856968.111140:0:18693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.111141:0:18693:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787856968.111145:0:18693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787856968.113043:0:18676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787856968.113135:0:18676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787856968.113168:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007ba200/0xc25410d92a3c4da5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dac expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856968.113184:0:18676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9066007ba200/0xc25410d92a3c4da5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dac expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856968.113194:0:18676:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065dfae1800 from 1 10000000:01000000:1.0:1787856968.113197:0:18676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856968.113285:0:18676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856968.113294:0:18676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856968.113308:0:18676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856968.113340:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787856968.113434:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.113496:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f5c30b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856968.113598:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436411520 00000100:00100000:3.0:1787856968.113609:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436411520 00000100:00100000:3.0:1787856968.113667:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787856968.113677:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436411520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856968.113693:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856968.113710:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4dc1 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.113740:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 20 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.113753:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 20 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.113764:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ffe00, rc 0) 00000100:00100000:3.0:1787856968.115108:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436411520:12345-0@lo:101:mount.lustre.0 Request processed in 1424us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856968.115123:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787856968.115447:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856968.115485:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856968.115498:0:18676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856968.120489:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787856968.121020:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856968.122464:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787856968.122547:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787856968.122578:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787856968.122586:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787856968.122725:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856968.123123:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.123189:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f5c30cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856968.125905:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436411648 00000100:00100000:0.0:1787856968.125930:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436411648 00000100:00100000:0.0:1787856968.126021:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787856968.126033:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436411648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856968.126308:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436411648:12345-0@lo:501:mount.lustre.0 Request processed in 277us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.126317:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787856968.126500:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856968.126576:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856968.126648:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856968.137619:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787856968.138896:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436411776 00000100:00100000:1.0:1787856968.138913:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436411776 00000100:00100000:1.0:1787856968.139003:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787856968.139016:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436411776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787856968.139253:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436411776:12345-0@lo:503:mount.lustre.0 Request processed in 239us (12604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856968.139262:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787856968.139437:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787856968.140099:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787856968.140251:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856968.140317:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856968.140368:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787856968.140562:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436411904 00000100:00100000:1.0:1787856968.140569:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436411904 00000100:00100000:1.0:1787856968.140621:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787856968.140630:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436411904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856968.140771:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436411904:12345-0@lo:502:mount.lustre.0 Request processed in 141us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856968.140779:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787856968.142398:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436411904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787856968.143053:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787856968.143121:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787856968.143138:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787856968.143175:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787856968.143316:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787856968.143337:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787856968.143353:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787856968.143366:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1787856968.143381:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787856968.143394:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1787856968.143488:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1787856968.143546:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856968.143631:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856968.143686:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787856968.145871:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436412032 00000100:00100000:0.0:1787856968.145889:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436412032 00000100:00100000:0.0:1787856968.145983:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787856968.145996:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436412032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856968.146260:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436412032:12345-0@lo:502:mount.lustre.0 Request processed in 266us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.146268:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787856968.148159:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787856968.148283:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787856968.148298:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787856968.153898:0:18697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856968.153917:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.153920:0:18697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787856968.153929:0:18697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065dfae1800 00000020:00000080:3.0:1787856968.153932:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787856968.153941:0:18697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856968.153944:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.153945:0:18697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787856968.153948:0:18697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856968.153951:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.153952:0:18697:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787856968.153955:0:18697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9065dfae1800 00000020:00000080:3.0:1787856968.153958:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787856968.154036:0:18697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856968.154040:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.154041:0:18697:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787856968.154044:0:18697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856968.154046:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.154048:0:18697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787856968.154051:0:18697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065dfae1800 00000020:00000080:3.0:1787856968.154053:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787856968.154069:0:18697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856968.154072:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.154073:0:18697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787856968.154075:0:18697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787856968.154077:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.154079:0:18697:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787856968.154082:0:18697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9065dfae1800 00000020:00000080:3.0:1787856968.154084:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787856968.154105:0:18697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787856968.154127:0:18697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856968.154129:0:18697:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787856968.154132:0:18697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787856968.154282:0:18676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787856968.154347:0:18676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787856968.154378:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.154392:0:18676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856968.154468:0:18676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787856968.154481:0:18676:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9065dfae1800 10000000:01000000:2.0:1787856968.154485:0:18676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9065dfae1800 10000000:01000000:2.0:1787856968.154492:0:18676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787856968.154498:0:18676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9065dfae1800 from 1 10000000:01000000:2.0:1787856968.154501:0:18676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787856968.154612:0:18676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215aa00/0xc25410d92a3c4dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.154640:0:18676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215aa00/0xc25410d92a3c4dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.154651:0:18676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215aa00/0xc25410d92a3c4dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856968.154677:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787856968.154749:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856968.154799:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd780 going to sleep for 11 seconds 00000100:00100000:0.0:1787856968.157650:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436412160 00000100:00100000:0.0:1787856968.157676:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436412160 00000100:00100000:0.0:1787856968.157765:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787856968.157776:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:18676:x1874703436412160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787856968.157801:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856968.157827:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bae00/0xc25410d92a3c4dd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4dcf expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856968.157864:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bae00/0xc25410d92a3c4dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4dcf expref: 21 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856968.157877:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bae00/0xc25410d92a3c4dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4dcf expref: 21 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856968.157887:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bae00, rc 0) 00000100:00100000:0.0:1787856968.158005:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412160:12345-0@lo:101:mount.lustre.0 Request processed in 231us (3255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.158013:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787856968.158376:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856968.158400:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215aa00/0xc25410d92a3c4dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dd6 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.158411:0:18676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215aa00/0xc25410d92a3c4dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4dd6 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856968.162748:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787856968.163287:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856968.163605:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787856968.163643:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787856968.163662:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787856968.163677:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787856968.163693:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787856968.163710:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787856968.163738:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787856968.163754:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787856968.163769:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787856968.163782:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787856968.163798:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787856968.163812:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787856968.163828:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787856968.163841:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787856968.163853:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787856968.163867:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787856968.163882:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787856968.163896:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787856968.163908:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787856968.163942:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787856968.163959:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787856968.163972:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787856968.163986:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787856968.164002:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787856968.164017:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787856968.164031:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787856968.164047:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787856968.164062:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787856968.164077:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787856968.164093:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787856968.164109:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787856968.164125:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787856968.164140:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787856968.164154:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787856968.164168:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787856968.164199:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787856968.164244:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787856968.164272:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787856968.164280:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787856968.164416:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856968.164536:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.164600:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856968.165674:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436412288 00000100:00100000:0.0:1787856968.165687:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436412288 00000100:00100000:0.0:1787856968.165823:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787856968.165835:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856968.166042:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412288:12345-0@lo:501:mount.lustre.0 Request processed in 208us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.166052:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787856968.173997:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856968.174083:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787856968.174199:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.174286:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b7d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856968.176705:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436412416 00000100:00100000:2.0:1787856968.176723:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436412416 00000100:00100000:2.0:1787856968.176817:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787856968.176831:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856968.177022:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412416:12345-0@lo:503:mount.lustre.0 Request processed in 194us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856968.177031:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787856968.182193:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787856968.184871:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856968.186052:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856968.186170:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.186565:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436412544 00000100:00100000:0.0:1787856968.186576:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436412544 00000100:00100000:1.0:1787856968.186718:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c4dd6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856968.186966:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787856968.186979:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856968.187195:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412544:12345-0@lo:502:mount.lustre.0 Request processed in 218us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.187205:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787856968.187350:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856968.195672:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787856968.195796:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787856968.195818:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787856968.195836:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787856968.195855:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787856968.195871:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787856968.195888:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787856968.195906:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787856968.195962:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787856968.195981:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787856968.196000:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787856968.196015:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787856968.196030:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787856968.196045:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787856968.196077:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787856968.196091:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787856968.196108:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787856968.196123:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787856968.196137:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787856968.196151:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787856968.196167:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787856968.196183:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787856968.196197:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787856968.196214:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787856968.196269:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787856968.196288:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787856968.196301:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787856968.196315:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787856968.196329:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787856968.196345:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787856968.196359:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787856968.196374:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787856968.196387:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787856968.196400:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787856968.196412:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787856968.196426:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787856968.196440:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787856968.196456:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787856968.196484:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787856968.196502:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787856968.196532:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787856968.196554:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787856968.196572:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787856968.196589:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787856968.196606:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787856968.196622:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787856968.196639:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787856968.196667:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787856968.196755:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856968.196874:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.201959:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c4dd6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856968.202075:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436412672 00000100:00100000:3.0:1787856968.202088:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436412672 00000100:00100000:2.0:1787856968.202395:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787856968.203373:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856968.203630:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412672:12345-0@lo:502:mount.lustre.0 Request processed in 276us (6755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856968.203638:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787856968.208893:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856968.209259:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787856968.209303:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787856968.209357:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856968.209455:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.209520:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c4dd6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856968.209619:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436412800 00000100:00100000:3.0:1787856968.209627:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436412800 00000100:00100000:3.0:1787856968.209889:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787856968.209904:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787856968.210070:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436412800:12345-0@lo:502:mount.lustre.0 Request processed in 169us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856968.210079:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787856968.214941:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436412800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856968.215103:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787856968.215135:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787856968.218815:0:18703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787856968.218841:0:18703:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9064c80833a0) 00000020:00000080:3.0:1787856968.218873:0:18703:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787856968.218988:0:18703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065dfae1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787856968.218993:0:18703:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065dfae1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787856968.218996:0:18703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065dfae1800 3 00010000:00080000:3.0:1787856968.219038:0:18703:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9065f71fc000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1787856968.223427:0:18703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787856968.225525:0:18703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787856968.225595:0:18703:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787856968.225625:0:18703:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc25410d92a3c4de4 00000100:00080000:3.0:1787856968.225642:0:18703:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787856968.225651:0:18703:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9065f71fc000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856968.225714:0:18703:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90660193c3c0 x1874703436412928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856968.225742:0:18703:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787856968.226204:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436412928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787856968.226321:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787856968.226417:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856968.226422:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856968.226425:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856968.226428:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856968.226453:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856968.226456:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856968.226458:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856968.226462:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787856968.226895:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436412928 00000100:00100000:0.0:1787856968.226906:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436412928 00000100:00100000:0.0:1787856968.226945:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856968.226954:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874703436412928:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787856968.227002:0:17175:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:0.0:1787856968.227042:0:17175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc25410d92a3c4deb 00000004:00100000:0.0:1787856968.227062:0:17175:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787856968.227105:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9064c79b3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856968.227178:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874703436412928:12345-0@lo:38:llog_process_th.0 Request processed in 223us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.227187:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856968.227247:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436413056:0@lo:400:kworker.0 00000100:00100000:0.0:1787856968.227284:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.227316:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856968.227323:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436413440:0@lo:400:kworker.0 00000100:00100000:0.0:1787856968.227351:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856968.227360:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436413056 00000100:00100000:2.0:1787856968.227375:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436413056 00000100:00100000:0.0:1787856968.227401:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436413184:0@lo:400:kworker.0 00000100:00100000:0.0:1787856968.227430:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.227449:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856968.227455:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436413312:0@lo:400:kworker.0 00000100:00100000:0.0:1787856968.227497:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856968.227507:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787856968.227522:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436413056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856968.227554:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436413440 00000100:00100000:0.0:1787856968.227571:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436413440 00000100:00100000:0.0:1787856968.227608:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436413184 00000100:00100000:0.0:1787856968.227612:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436413184 00000100:00100000:2.0:1787856968.227630:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436413056:12345-0@lo:400:kworker.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.227635:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787856968.227644:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436413440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856968.227669:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787856968.227693:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436413312 00000100:00100000:2.0:1787856968.227697:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436413312 00000100:00100000:0.0:1787856968.227713:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436413440:12345-0@lo:400:kworker.0 Request processed in 68us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856968.227721:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787856968.227726:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787856968.227732:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436413312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856968.227753:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856968.227765:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436413184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856968.227786:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436413312:12345-0@lo:400:kworker.0 Request processed in 55us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856968.227795:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787856968.227822:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436413184:12345-0@lo:400:kworker.0 Request processed in 57us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.227831:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787856968.227852:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c83f9e00 x1874703436413440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856968.227868:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436413440:0@lo:400:kworker.0 00000100:00100000:2.0:1787856968.227881:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436413056:0@lo:400:kworker.0 00000100:00100000:2.0:1787856968.227917:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436413312:0@lo:400:kworker.0 00010000:00080000:2.0:1787856968.227928:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c83fa1c0 x1874703436413184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856968.227939:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436413184:0@lo:400:kworker.0 00000020:01000004:3.0:1787856968.229453:0:18703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787856968.229511:0:18703:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9064c6878000) 00000020:00000080:3.0:1787856968.229547:0:18703:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787856968.229688:0:18703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9065dfae1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787856968.229694:0:18703:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9065dfae1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787856968.229699:0:18703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9065dfae1800 3 00010000:00080000:3.0:1787856968.229744:0:18703:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9065f73ac000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00080000:1.0:1787856968.232855:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90660193c3c0 x1874703436412928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856968.232874:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787856968.232888:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787856968.232903:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787856968.232911:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787856968.232916:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065f71fc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787856968.232928:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874703436412928:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1787856968.239084:0:18703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787856968.239508:0:18703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787856968.239563:0:18703:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787856968.239577:0:18703:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc25410d92a3c4df9 00000100:00080000:2.0:1787856968.239588:0:18703:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787856968.239594:0:18703:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9065f73ac000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856968.239631:0:18703:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c826c000 x1874703436413568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787856968.239677:0:18703:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787856968.243452:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856968.243467:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856968.243479:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856968.243485:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856968.243492:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856968.243496:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787856968.243503:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856968.243507:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787856968.243958:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787856968.244455:0:18676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787856968.244500:0:18676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787856968.244519:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215aa00/0xc25410d92a3c4dcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dd6 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856968.244530:0:18676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215aa00/0xc25410d92a3c4dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4dd6 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787856968.244581:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787856968.244583:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787856968.244585:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856968.244586:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856968.244588:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856968.244589:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856968.244591:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856968.244593:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856968.244594:0:18676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787856968.244599:0:18676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787856968.244601:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787856968.244603:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787856968.244604:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856968.244605:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856968.244606:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856968.244614:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856968.244614:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856968.244615:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856968.244616:0:18676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787856968.244650:0:18676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787856968.244672:0:18676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436413696:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787856968.244750:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856968.244791:0:18676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787856968.244817:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436413696 00000100:00100000:1.0:1787856968.244824:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436413696 00000100:00100000:1.0:1787856968.244872:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787856968.244882:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:18676:x1874703436413696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787856968.244908:0:17166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787856968.244924:0:17166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787856968.248552:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874703436413568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787856968.248666:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856968.249178:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436413568 00000100:00100000:0.0:1787856968.249189:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436413568 00000100:00100000:0.0:1787856968.249278:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787856968.249288:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874703436413568:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787856968.249347:0:17176:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:0.0:1787856968.249396:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc25410d92a3c4e00 00000004:00100000:0.0:1787856968.249416:0:17176:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787856968.249461:0:17176:0:(import.c:65:import_set_state_nolock()) ffff9064c79b2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856968.249552:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874703436413568:12345-0@lo:38:llog_process_th.0 Request processed in 263us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856968.249561:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787856968.249687:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9064c826c000 x1874703436413568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856968.249715:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787856968.249727:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787856968.249737:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787856968.249742:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787856968.249745:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065f73ac000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787856968.249753:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874703436413568:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1787856968.254371:0:17166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787856968.254390:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787856968.254531:0:17190:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787856968.254536:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787856968.254557:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.254577:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.254586:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.254594:0:17190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.254642:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.254657:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 21 pid: 17166 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856968.254674:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436413824:0@lo:104: 00000100:00100000:2.0:1787856968.254739:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856968.254774:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436413824 00010000:00010000:2.0:1787856968.254782:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856968.254783:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436413824 00010000:00010000:2.0:1787856968.254794:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 21 pid: 17167 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856968.254818:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436413952:0@lo:104: 00000100:00100000:3.0:1787856968.254840:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856968.254845:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856968.254852:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436413824:12345-0@lo:104: 00000100:00100000:2.0:1787856968.254858:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb42e840 going to sleep for 11 seconds 00010000:00010000:3.0:1787856968.254875:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.254936:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787856968.254944:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436413824:12345-0@lo:104: Request processed in 95us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856968.254953:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856968.254970:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436413824:0@lo:104: 00000100:00100000:3.0:1787856968.254979:0:17157:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787856968.254984:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787856968.254990:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436413952 00010000:00010000:2.0:1787856968.254992:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856968.254995:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436413952 00010000:00010000:2.0:1787856968.255003:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938a00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856968.255008:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856968.255016:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787856968.255020:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856968.255024:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066007e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436413952:12345-0@lo:104: 10000000:00010000:2.0:1787856968.255035:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.255038:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856968.255050:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787856968.255086:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856968.255092:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787856968.255094:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787856968.255100:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066007e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436413952:12345-0@lo:104: Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856968.255109:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787856968.255119:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255127:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c4d58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d5f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255153:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856968.255157:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856968.255157:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255165:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215be00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:2.0:1787856968.255169:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255175:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787856968.255181:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856968.255185:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787856968.255200:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255205:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787856968.255292:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255300:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660215be00/0xc25410d92a3c4d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d51 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255313:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856968.255315:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856968.255316:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856968.255339:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436413952:0@lo:104: 00010000:00010000:2.0:1787856968.255364:0:17190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856968.255388:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436414080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856968.255431:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856968.255477:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787856968.255487:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3626:1874703436414208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856968.255512:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856968.255544:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436414080 00000100:00100000:2.0:1787856968.255548:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436414080 00010000:00010000:2.0:1787856968.255565:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 22 pid: 17166 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856968.255585:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436414208 00000100:00100000:2.0:1787856968.255589:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436414208 00010000:00010000:2.0:1787856968.255599:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 23 pid: 17167 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856968.255611:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856968.255618:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:3624:x1874703436414080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787856968.255627:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856968.255632:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 23 pid: 17166 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255642:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 23 pid: 17166 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255656:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660215b800/0xc25410d92a3c4d5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4d58 expref: 23 pid: 17166 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255676:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856968.255705:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:3624:x1874703436414080:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856968.255712:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787856968.255725:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787856968.255732:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660068a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3626:x1874703436414208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787856968.255739:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787856968.255744:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 21 pid: 17167 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255752:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 21 pid: 17167 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255763:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4d51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4d4a expref: 21 pid: 17167 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255773:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255781:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787856968.255792:0:17159:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010881612s 00010000:00010000:2.0:1787856968.255796:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255802:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255819:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255825:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255830:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215ba00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856968.255834:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255843:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255860:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.255871:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787856968.255915:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660068a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:3626:x1874703436414208:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856968.255922:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787856968.255995:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436414080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787856968.256011:0:17190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.256018:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856968.256023:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660215ba00/0xc25410d92a3c4e07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856968.256056:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3626:1874703436414208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856968.256837:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:18676:x1874703436413696:12345-0@lo:253:mount.lustre.0 Request processed in 11950us (12080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856968.256850:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787856968.262317:0:18676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:18676:1874703436413696:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787856968.262340:0:18676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787856968.262343:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787856968.262345:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787856968.262347:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856968.262348:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856968.262349:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856968.262351:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856968.262353:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856968.262355:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856968.262356:0:18676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787856968.262374:0:18676:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1787856968.290322:0:18676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787856968.302068:0:18676:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787856968.302079:0:18676:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787856968.302124:0:18676:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787856968.302184:0:18676:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787856968.302205:0:18676:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787856968.302252:0:18676:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787856968.303419:0:18676:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787856968.303684:0:18676:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787856968.405121:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856969.426662:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787856969.463026:0:18756:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856969.463283:0:18756:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787856970.018166:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787856970.018178:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065fe85c800 from 9 10000000:01000000:2.0:1787856970.018185:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787856970.020520:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856970.020542:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856970.020564:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856970.020606:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436414336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787856970.020706:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856970.020863:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb4f9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856970.032670:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436414336 00000100:00100000:0.0:1787856970.032691:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436414336 00000100:00100000:2.0:1787856970.033649:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787856970.033667:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+19:17170:x1874703436414336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856970.033694:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856970.033730:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4e0e expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856970.033795:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 20 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856970.033809:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 20 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856970.033822:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215bc00, rc 0) 00000100:00100000:2.0:1787856970.033954:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:17170:x1874703436414336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 291us (13247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856970.033963:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787856970.034402:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436414336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856970.034427:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856970.034437:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856970.034525:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436414464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787856970.034585:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856970.034624:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d22d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856970.034746:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436414464 00000100:00100000:2.0:1787856970.034753:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436414464 00000100:00100000:2.0:1787856970.034797:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787856970.034805:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:17170:x1874703436414464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787856970.034824:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787856970.034845:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787856970.034848:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787856970.035007:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:17170:x1874703436414464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 202us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856970.035014:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787856970.035110:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436414464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787856970.035193:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787856970.035201:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856970.035246:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856970.035259:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787856970.035262:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065c52b7000 from 9 10000000:01000000:1.0:1787856970.035380:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787856970.035408:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856970.035416:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856970.035425:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856970.035440:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436414592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787856970.035484:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856970.035510:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb7603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856970.035591:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436414592 00000100:00100000:3.0:1787856970.035597:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436414592 00000100:00100000:3.0:1787856970.035649:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787856970.035656:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:17170:x1874703436414592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856970.035666:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856970.035680:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4e1c expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856970.035701:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856970.035713:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856970.035723:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe800, rc 0) 00000100:00100000:3.0:1787856970.035761:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436414592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856970.035768:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787856970.035941:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436414592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856970.035955:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856970.035964:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856970.036009:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436414720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787856970.036040:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856970.036076:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb7603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856970.036249:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436414720 00000100:00100000:3.0:1787856970.036255:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436414720 00000100:00100000:3.0:1787856970.036350:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787856970.036358:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436414720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787856970.036372:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787856970.036387:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787856970.036390:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787856970.036483:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436414720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856970.036490:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787856970.037093:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436414720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787856970.037169:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787856970.037178:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856970.037189:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856970.449689:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856971.095867:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436414848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787856971.095983:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856971.096076:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436414848 00000100:00100000:0.0:1787856971.096089:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436414848 00000100:00100000:0.0:1787856971.096154:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787856971.096164:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436414848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787856971.096255:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787856971.096310:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436414848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856971.096317:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787856971.096375:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436414848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856971.096570:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856971.096582:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436414976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856971.096616:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856971.096964:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436414976 00000100:00100000:0.0:1787856971.096970:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436414976 00000100:00100000:0.0:1787856971.097006:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787856971.097015:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436414976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787856971.097040:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787856971.097092:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436414976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856971.097098:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787856971.100658:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436414976:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787856971.478025:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787856972.180878:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787856972.500715:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856973.525722:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787856973.663683:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856973.663702:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856973.663705:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856973.663708:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856973.663728:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856973.663731:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787856973.663733:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856973.663736:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787856973.663789:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436415488:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.663867:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856973.663910:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787856973.663917:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3623:1874703436415104:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.663946:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856973.663973:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436415616:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.663998:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856973.664038:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436415232:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664060:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856973.664085:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436415744:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664110:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856973.664128:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787856973.664134:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436415360:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664154:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856973.664169:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436415872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664200:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856973.664253:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436415488 00000100:00100000:3.0:1787856973.664260:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436415488 00000100:00100000:3.0:1787856973.664297:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436415232 00000100:00100000:3.0:1787856973.664301:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436415232 00000100:00100000:3.0:1787856973.664316:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787856973.664324:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436415488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664377:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436415488:12345-0@lo:400:kworker.0 Request processed in 52us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856973.664383:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787856973.664400:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787856973.664405:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436415232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664450:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436415232:12345-0@lo:400:kworker.0 Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856973.664455:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787856973.664472:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436415104 00000100:00100000:3.0:1787856973.664475:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436415104 00000100:00100000:3.0:1787856973.664500:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787856973.664506:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3623:x1874703436415104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664534:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3623:x1874703436415104:12345-0@lo:400:kworker.0 Request processed in 29us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856973.664540:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787856973.664567:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436415616 00000100:00100000:3.0:1787856973.664573:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436415616 00000100:00100000:3.0:1787856973.664592:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436415744 00000100:00100000:3.0:1787856973.664594:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436415744 00000100:00100000:3.0:1787856973.664622:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436415360 00000100:00100000:3.0:1787856973.664625:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436415360 00000100:00100000:3.0:1787856973.664645:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436415872 00000100:00100000:3.0:1787856973.664648:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436415872 00000100:00100000:3.0:1787856973.664662:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856973.664667:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436415616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664696:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436415616:12345-0@lo:400:kworker.0 Request processed in 29us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856973.664701:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856973.664712:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856973.664718:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436415744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664743:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874703436415744:12345-0@lo:400:kworker.0 Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856973.664748:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856973.664758:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787856973.664763:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436415360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664789:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436415360:12345-0@lo:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856973.664794:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787856973.664804:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787856973.664810:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436415872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664833:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436415872:12345-0@lo:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856973.664838:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787856973.664882:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193f480 x1874703436415360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856973.664897:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436415360:0@lo:400:kworker.0 00010000:00080000:3.0:1787856973.664920:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193f840 x1874703436415872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856973.664928:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436415872:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664937:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436415232:0@lo:400:kworker.0 00010000:00080000:3.0:1787856973.664946:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193c780 x1874703436415744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856973.664953:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874703436415744:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.664983:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3623:1874703436415104:0@lo:400:kworker.0 00010000:00080000:3.0:1787856973.664993:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193e940 x1874703436415616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856973.665000:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436415616:0@lo:400:kworker.0 00000100:00100000:3.0:1787856973.665009:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436415488:0@lo:400:kworker.0 00000100:00080000:3.0:1787856973.665069:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856973.665073:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787856974.545985:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856975.441375:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856960/real 1787856960] req@ffff9064c8240f00 x1874703436408320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856975 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856975.441420:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c8240f00 x1874703436408320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856975 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856975.441431:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856960/real 1787856960] req@ffff9064c8241a40 x1874703436408448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856975 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856975.441443:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9064c8241a40 x1874703436408448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856975 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787856975.441463:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065eb5d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856975.441484:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787856975.441488:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436408320:0@lo:8:kworker.0 00000100:00080000:1.0:1787856975.441494:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856975.441499:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787856975.441510:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8241a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436408448:0@lo:8:kworker.0 00000100:00080000:1.0:1787856975.441592:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856975.441597:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856975.441600:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856975.441602:0:14203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787856975.441628:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856975.441631:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787856975.441633:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9065eb5d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856975.441638:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 494 00000100:00080000:1.0:1787856975.441645:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787856975.441652:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9065eb5d8800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856975.441671:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83fb480 x1874703436416512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856975.441684:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856975.441686:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787856975.441688:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856975.441691:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 494 00000100:00080000:1.0:1787856975.441693:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787856975.441697:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9064c8172000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856975.441706:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c83f9680 x1874703436416640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856975.441746:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3623:1874703436416000:0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.441808:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856975.441851:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436416768:0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.441877:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856975.441897:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787856975.441902:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436416128:0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.441933:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856975.441951:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d2759a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436416896:0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.441970:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856975.441997:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436416256:0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.442036:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856975.442054:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436417024:0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.442078:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856975.442088:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787856975.443025:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436416768 00000100:00100000:0.0:1787856975.443037:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436416768 00000100:00100000:0.0:1787856975.443075:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436416896 00000100:00100000:0.0:1787856975.443078:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436416896 00000100:00100000:0.0:1787856975.443105:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436416256 00000100:00100000:0.0:1787856975.443107:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436416256 00000100:00100000:0.0:1787856975.443121:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436417024 00000100:00100000:0.0:1787856975.443124:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436417024 00000100:00100000:0.0:1787856975.443142:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787856975.443150:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436416768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856975.443239:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436416768:12345-0@lo:400:kworker.0 Request processed in 66us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856975.443247:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787856975.443274:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787856975.443280:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436416896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856975.443312:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436416896:12345-0@lo:400:kworker.0 Request processed in 32us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856975.443318:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787856975.443329:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787856975.443334:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436416256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856975.443360:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874703436416256:12345-0@lo:400:kworker.0 Request processed in 26us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856975.443367:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787856975.443377:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856975.443383:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436417024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856975.443422:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436417024:12345-0@lo:400:kworker.0 Request processed in 40us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856975.443428:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856975.443449:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436416000 00000100:00100000:0.0:1787856975.443452:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436416000 00000100:00100000:0.0:1787856975.443477:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787856975.443483:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3623:x1874703436416000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856975.443512:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3623:x1874703436416000:12345-0@lo:400:kworker.0 Request processed in 29us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856975.443517:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787856975.443548:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787856975.443552:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856975.443570:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436416512:0@lo:8:kworker.0 00000100:00100000:0.0:1787856975.443602:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856975.443632:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436416640:0@lo:8:kworker.0 00000100:00100000:0.0:1787856975.443653:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856975.443660:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436416384:0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.443691:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856975.443695:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436416512 00000100:00100000:0.0:1787856975.443699:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436416512 00000100:00100000:0.0:1787856975.443713:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436416640 00000100:00100000:0.0:1787856975.443716:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436416640 00000100:00100000:0.0:1787856975.443724:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787856975.443727:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c83fb840 x1874703436416256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856975.443729:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874703436416512:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787856975.443740:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874703436416256:0@lo:400:kworker.0 00010000:00080000:1.0:1787856975.443751:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065d275b480 x1874703436417024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787856975.443754:0:18680:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000100:00100000:1.0:1787856975.443759:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436417024:0@lo:400:kworker.0 00000020:00000080:0.0:1787856975.443782:0:18680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c4e2a 00000100:00100000:1.0:1787856975.443790:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436416128 00000100:00100000:1.0:1787856975.443794:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436416128 00002000:00100000:0.0:1787856975.443795:0:18680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9064c79b0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787856975.443799:0:18680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787856975.443802:0:18680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787856975.443817:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436416384 00000100:00100000:1.0:1787856975.443820:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436416384 00000100:00100000:1.0:1787856975.443830:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787856975.443842:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436416128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.443873:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436416128:12345-0@lo:400:kworker.0 Request processed in 33us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856975.443879:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787856975.443891:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787856975.443896:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436416384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.443937:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436416384:12345-0@lo:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856975.443944:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00002000:00080000:0.0:1787856975.443970:0:18680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1787856975.443984:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436416128:0@lo:400:kworker.0 00000100:00080000:0.0:1787856975.443994:0:18680:0:(import.c:65:import_set_state_nolock()) ffff9064c79b7000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787856975.444007:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9065d2759a40 x1874703436416896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856975.444017:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d2759a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436416896:0@lo:400:kworker.0 00000100:00100000:1.0:1787856975.444027:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3623:1874703436416000:0@lo:400:kworker.0 00000100:00100000:0.0:1787856975.444029:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1874703436416512:12345-0@lo:8:kworker.0 Request processed in 300us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856975.444036:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787856975.444037:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c83f9e00 x1874703436416768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856975.444045:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436416768:0@lo:400:kworker.0 00000100:00100000:0.0:1787856975.444048:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856975.444051:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874703436416640:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787856975.444061:0:18680:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787856975.444072:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436416384:0@lo:400:kworker.0 00010000:00080000:1.0:1787856975.446340:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c83fb480 x1874703436416512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787856995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856975.446354:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787856975.446363:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787856975.446371:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787856975.446383:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787856975.446387:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065eb5d8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787856975.446415:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787856975.446422:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436416512:0@lo:8:kworker.0 00000100:00100000:1.0:1787856975.448243:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436417152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856975.448383:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787856975.448465:0:17916:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000401:0x1:0x0] 00000100:00100000:3.0:1787856975.448491:0:17916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874703436417280:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787856975.448525:0:17916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856975.448543:0:17916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001000 going to sleep for 11 seconds 00000100:00100000:3.0:1787856975.448575:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436417152 00000100:00100000:3.0:1787856975.448581:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436417152 00000100:00100000:3.0:1787856975.448640:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856975.448649:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1874703436417152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787856975.448685:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787856975.448770:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1874703436417152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856975.448778:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856975.448816:0:18683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787856975.448823:0:18683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1787856975.448997:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193da40 x1874703436417152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856975.449079:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436417152:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1787856975.449272:0:17915:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1787856975.449510:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787856975.449592:0:17915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 509159374044ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787856975.449599:0:17915:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1787856975.452434:0:17906:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787856975.460465:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436417280 00000100:00100000:3.0:1787856975.460479:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436417280 00000100:00100000:1.0:1787856975.467861:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856975.467881:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17916:x1874703436417280:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787856975.472247:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874703436416640:12345-0@lo:8:kworker.0 Request processed in 28152us (28550us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787856975.472265:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787856975.472586:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787856975.472594:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787856975.472598:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436416640:0@lo:8:kworker.0 00002000:00080000:0.0:1787856975.475696:0:18998:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787856975.475705:0:18998:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x21:0x0] 00000100:00100000:0.0:1787856975.476483:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17916:x1874703436417280:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8604us (27951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856975.476504:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787856975.489151:0:17916:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193e940 x1874703436417280/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787856991 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856975.489172:0:17916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874703436417280:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787856975.489189:0:17916:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000401:0x21:0x0] 00000100:00100000:1.0:1787856975.489257:0:17916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874703436417408:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787856975.489316:0:17916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856975.489350:0:17916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb59ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856975.489444:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436417408 00000100:00100000:2.0:1787856975.489452:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436417408 00000100:00100000:2.0:1787856975.489506:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856975.489524:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17916:x1874703436417408:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787856975.489552:0:18683:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787856975.489598:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17916:x1874703436417408:12345-0@lo:5:osp-pre-0-1.0 Request processed in 75us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856975.489604:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787856975.489635:0:17916:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a78f00 x1874703436417408/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856991 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856975.489644:0:17916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874703436417408:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787856975.489652:0:17916:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x21:0x0] 00000100:00100000:2.0:1787856975.489677:0:17916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874703436417536:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787856975.489699:0:17916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856975.489716:0:17916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f5c30900 going to sleep for 11 seconds 00000100:00100000:2.0:1787856975.489728:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436417536 00000100:00100000:2.0:1787856975.489731:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436417536 00000100:00100000:2.0:1787856975.489756:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856975.489762:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17916:x1874703436417536:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787856975.489787:0:18680:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1787856975.519952:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787856975.519969:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787856975.520248:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17916:x1874703436417536:12345-0@lo:5:osp-pre-0-1.0 Request processed in 30481us (30543us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787856975.520260:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787856975.523057:0:17916:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c826c000 x1874703436417536/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787856991 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856975.523073:0:17916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787856975.523080:0:17916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17916:1874703436417536:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787856975.523097:0:17916:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1787856975.523156:0:17916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17916:1874703436417664:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787856975.523213:0:17916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856975.523332:0:17916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7001000 going to sleep for 11 seconds 00000100:00100000:1.0:1787856975.526578:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436417664 00000100:00100000:1.0:1787856975.526598:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436417664 00000100:00100000:1.0:1787856975.526659:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856975.526671:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17916:x1874703436417664:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787856975.526770:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17916:x1874703436417664:12345-0@lo:900:osp-pre-0-1.0 Request processed in 101us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856975.526777:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787856975.526867:0:17916:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193c780 x1874703436417664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787856991 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856975.526883:0:17916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17916:1874703436417664:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787856975.571886:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787856975.942643:0:19047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1787856976.017897:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787856976.214116:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436417792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856976.214196:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856976.214283:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436417792 00000100:00100000:3.0:1787856976.214291:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436417792 00000100:00100000:3.0:1787856976.214342:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787856976.214352:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436417792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856976.214386:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787856976.214443:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436417792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856976.214451:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787856976.214496:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436417792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856976.218969:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436417920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856976.219044:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856976.219253:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436417920 00000100:00100000:2.0:1787856976.219261:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436417920 00000100:00100000:2.0:1787856976.219306:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787856976.219315:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436417920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787856976.219349:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787856976.219420:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436417920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856976.219428:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787856976.219668:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436417920:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787856976.593357:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787856976.891009:0:19099:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856976.891212:0:19099:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787856977.617458:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787856977.727560:0:19149:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787856977.732019:0:19149:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787856978.515197:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856958/real 1787856958] req@ffff906601a3c3c0 x1874703436406656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856978 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856978.515264:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff906601a3c3c0 x1874703436406656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856978 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856978.515275:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787856958/real 1787856958] req@ffff906601a3f840 x1874703436406784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856978 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856978.515287:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff906601a3f840 x1874703436406784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787856978 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787856978.515307:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065c8dae800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856978.515326:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787856978.515330:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436406656:0@lo:8:kworker.0 00000100:00080000:0.0:1787856978.515335:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856978.515340:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787856978.515343:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436406784:0@lo:8:kworker.0 00000100:00080000:3.0:1787856978.515483:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856978.515487:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787856978.515490:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9065c8dae800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856978.515495:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1787856978.515501:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787856978.515507:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9065c8dae800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856978.515526:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90660193e940 x1874703436418304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856978.515541:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856978.515557:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787856978.515559:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856978.515562:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1787856978.515564:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787856978.515568:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9066007b3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856978.515580:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90660193da40 x1874703436418432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856978.515617:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787856978.515620:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787856978.515621:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787856978.515625:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:3.0:1787856978.515627:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787856978.515630:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9064c8172000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1787856978.515640:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3e940 x1874703436418944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787856978.515692:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436418560:0@lo:400:kworker.0 00000100:00100000:2.0:1787856978.515734:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436418176:0@lo:400:kworker.0 00000100:00100000:3.0:1787856978.515759:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856978.515764:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856978.515812:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436418048:0@lo:400:kworker.0 00000100:00100000:3.0:1787856978.515846:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436419200:0@lo:400:kworker.0 00000100:00100000:2.0:1787856978.518641:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436419072:0@lo:400:kworker.0 00000100:00100000:2.0:1787856978.518707:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856978.518774:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436418560 00000100:00100000:2.0:1787856978.518784:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436418560 00000100:00100000:2.0:1787856978.518827:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436419072 00000100:00100000:2.0:1787856978.518830:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436419072 00000100:00100000:2.0:1787856978.518846:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787856978.518854:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436418560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856978.518924:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436418560:12345-0@lo:400:kworker.0 Request processed in 69us (3165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856978.518932:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787856978.518950:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787856978.518956:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436419072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856978.518985:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436419072:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856978.518992:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787856978.519042:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a3cb40 x1874703436419072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856978.519056:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436419072:0@lo:400:kworker.0 00000100:00100000:2.0:1787856978.519665:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436418304:0@lo:8:kworker.0 00000100:00100000:2.0:1787856978.519708:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856978.519735:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436418432:0@lo:8:kworker.0 00000100:00100000:2.0:1787856978.519761:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856978.519778:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436418944:0@lo:8:kworker.0 00000100:00100000:2.0:1787856978.519796:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856978.519823:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436418304 00000100:00100000:2.0:1787856978.519828:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436418432 00000100:00100000:1.0:1787856978.519829:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436418304 00000100:00100000:2.0:1787856978.519830:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436418432 00000100:00100000:0.0:1787856978.519894:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856978.519919:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436418816:0@lo:400:kworker.0 00000100:00100000:0.0:1787856978.519942:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856978.520516:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436418048 00000100:00100000:0.0:1787856978.520532:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436418048 00000100:00100000:0.0:1787856978.520566:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787856978.520574:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3625:x1874703436418048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856978.520617:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3625:x1874703436418048:12345-0@lo:400:kworker.0 Request processed in 44us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856978.520623:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787856978.520666:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436418048:0@lo:400:kworker.0 00000100:00100000:1.0:1787856978.520744:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436418944 00000100:00100000:1.0:1787856978.520749:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436418944 00000100:00100000:1.0:1787856978.520765:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436418816 00000100:00100000:1.0:1787856978.520768:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436418816 00000100:00100000:1.0:1787856978.520798:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787856978.520806:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436418816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856978.520842:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436418816:12345-0@lo:400:kworker.0 Request processed in 38us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856978.520849:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787856978.520862:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787856978.520866:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874703436418304:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787856978.520892:0:18998:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1787856978.520922:0:18998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c4e31 00002000:00100000:1.0:1787856978.520935:0:18998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9065df94d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787856978.520939:0:18998:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787856978.520941:0:18998:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787856978.521024:0:18998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787856978.521072:0:18998:0:(import.c:65:import_set_state_nolock()) ffff9065df94b000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1787856978.521176:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a3c000 x1874703436418816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787856994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856978.521188:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436418816:0@lo:400:kworker.0 00000100:00100000:3.0:1787856978.521288:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856978.521319:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436419200 00000100:00100000:3.0:1787856978.521323:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436419200 00000100:00100000:3.0:1787856978.521353:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787856978.521362:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436419200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856978.521405:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436419200:12345-0@lo:400:kworker.0 Request processed in 45us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856978.521421:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787856978.521447:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436418688:0@lo:400:kworker.0 00000100:00100000:3.0:1787856978.521479:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856978.521501:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436419328:0@lo:400:kworker.0 00000100:00100000:3.0:1787856978.521523:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856978.521555:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436418176 00000100:00100000:3.0:1787856978.521558:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436418176 00000100:00100000:3.0:1787856978.521583:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436418688 00000100:00100000:3.0:1787856978.521586:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436418688 00000100:00100000:3.0:1787856978.521601:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787856978.521607:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436418176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856978.521647:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436418176:12345-0@lo:400:kworker.0 Request processed in 40us (5881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856978.521653:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787856978.521665:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787856978.521671:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436418688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856978.522324:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436419328 00000100:00100000:0.0:1787856978.522330:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436419328 00000100:00100000:0.0:1787856978.522358:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787856978.522365:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436419328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856978.522423:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436419328:12345-0@lo:400:kworker.0 Request processed in 57us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856978.522430:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787856978.522673:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436418688:12345-0@lo:400:kworker.0 Request processed in 1002us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856978.522803:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1874703436418304:12345-0@lo:8:kworker.0 Request processed in 1933us (3093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856978.522812:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787856978.522829:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787856978.522834:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874703436418432:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787856978.522851:0:18998:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787856978.522877:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874703436418432:12345-0@lo:8:kworker.0 Request processed in 43us (3115us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787856978.522882:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787856978.522894:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787856978.522898:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874703436418944:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787856978.522906:0:18998:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787856978.522924:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1874703436418944:12345-0@lo:8:kworker.0 Request processed in 25us (3127us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787856978.522930:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787856978.522943:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787856978.522947:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856978.522950:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856978.523170:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787856978.523338:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193e940 x1874703436418304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787857003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856978.523350:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787856978.523358:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787856978.523366:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787856978.523371:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787856978.523382:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9065c8dae800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787856978.523402:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787856978.523423:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436418304:0@lo:8:kworker.0 00000100:00080000:0.0:1787856978.523438:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856978.523442:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787856978.523445:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436418432:0@lo:8:kworker.0 00000100:00080000:0.0:1787856978.523453:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856978.523456:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787856978.523459:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436418944:0@lo:8:kworker.0 00000100:00100000:3.0:1787856978.523543:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436418688:0@lo:400:kworker.0 00010000:00080000:3.0:1787856978.523555:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a3c780 x1874703436419328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856978.523565:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436419328:0@lo:400:kworker.0 00000004:00080000:3.0:1787856978.523609:0:17199:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787856978.523636:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17199:1874703436419584:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787856978.523670:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787856978.524327:0:17198:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787856978.524429:0:17198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 512234211075ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787856978.524436:0:17198:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787856978.524786:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436419456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856978.524828:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856978.524879:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436419456 00000100:00100000:0.0:1787856978.524884:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436419456 00000100:00100000:0.0:1787856978.524929:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856978.524937:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436419456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856978.524963:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787856978.524997:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436419456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856978.525004:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787856978.525021:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787856978.525047:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c70ee580 x1874703436419456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856978.525064:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436419456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856978.525210:0:17199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c4dd6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787856978.525391:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436418176:0@lo:400:kworker.0 00000004:00080000:0.0:1787856978.527931:0:17154:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787856978.534880:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436419584 00000100:00100000:2.0:1787856978.534895:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436419584 00000100:00100000:2.0:1787856978.534949:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787856978.534959:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17199:x1874703436419584:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1787856978.539541:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a3e580 x1874703436419200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856978.539560:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436419200:0@lo:400:kworker.0 00010000:00080000:3.0:1787856978.539597:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a3f840 x1874703436418560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856978.539606:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436418560:0@lo:400:kworker.0 00002000:00080000:2.0:1787856978.542777:0:18683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787856978.542793:0:18683:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787856978.542802:0:18683:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1787856978.555503:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787856978.555517:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.555536:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=512s v=(0 0) 00010000:00010000:2.0:1787856978.555542:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856978.555549:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.555567:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.562903:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.562926:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.562961:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.563460:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.563469:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563479:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.563493:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563504:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563528:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563536:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c688d231/0xc25410d92a3c4e38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563560:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.563562:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.563563:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787856978.563702:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787856978.563710:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.563721:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=512s v=(0 0) 00010000:00010000:2.0:1787856978.563725:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856978.563732:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.563745:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.563753:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.563760:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.563793:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.563812:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.563817:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563825:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215ae00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.563828:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563835:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563846:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563860:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5677497/0xc25410d92a3c4e3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.563873:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.563875:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.563877:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.565518:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.565529:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.565546:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.565550:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.565556:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.565571:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.565580:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.565600:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.565670:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856978.566276:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.566282:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.566294:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.566297:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.566302:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.566312:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.566321:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.566329:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.567052:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856978.567062:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.567072:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.567077:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.567086:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.567104:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.567111:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.567159:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856978.567166:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.567188:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856978.567192:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.567200:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.567239:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.567249:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.567251:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.567253:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856978.571687:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787856978.571702:0:18683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856978.572321:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.572328:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.572344:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.572349:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.572367:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.572391:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.572401:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.572409:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.575364:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.575387:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.575419:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.575425:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.575437:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.575462:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.575561:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.575565:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.575567:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856978.575680:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787856978.575689:0:18683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d16d0bfc/0xc25410d92a3c4e54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.575764:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.576464:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.576472:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.576498:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.576502:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.576509:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.576522:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.576531:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.576538:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.576559:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856978.576710:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856978.576717:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.576727:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856978.576731:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.576741:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.576764:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.576771:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2a7d4e/0xc25410d92a3c4e5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.576792:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.576794:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.576795:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.576973:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.576983:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.576992:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.576995:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.576999:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577008:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577028:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577035:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577056:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856978.577172:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856978.577178:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577186:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856978.577189:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577198:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577209:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577234:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ee9b244/0xc25410d92a3c4e62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577261:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.577262:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.577264:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.577504:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.577510:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577520:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.577523:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.577527:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577536:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577543:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577550:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577582:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856978.577764:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856978.577770:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577778:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856978.577782:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577790:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577802:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577809:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019eae3d6/0xc25410d92a3c4e69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.577823:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.577825:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.577826:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.577974:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.577981:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.577990:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.577993:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.577997:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.578007:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.578015:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.578023:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.578044:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856978.578074:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856978.578080:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.578111:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856978.578115:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.578124:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.578135:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.578142:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055cf7310/0xc25410d92a3c4e70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.578156:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.578158:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.578159:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.578981:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.578989:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.579001:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.579012:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.579017:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.579028:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.579036:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.579043:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.579067:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856978.579119:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856978.579126:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.579134:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856978.579138:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.579147:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.579169:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.579177:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000790d81e4/0xc25410d92a3c4e77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.579193:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.579196:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.579197:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.580170:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.580179:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580192:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.580195:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.580200:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580212:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580281:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580299:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580321:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.580661:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.580668:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.580677:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.580681:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.580689:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.580705:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.580712:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d69f7b4/0xc25410d92a3c4e7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.580736:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.580738:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.580739:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.580834:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.580840:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580849:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.580852:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.580857:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580866:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580873:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.580881:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.581026:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856978.581068:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856978.581076:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.581097:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fee00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856978.581102:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.581111:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.581124:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.581131:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3cb418a/0xc25410d92a3c4e85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.581158:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.581161:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.581163:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.581437:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.581443:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.581459:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.581462:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.581466:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.581475:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.581483:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.581491:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.581510:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.581628:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.581634:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.581642:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.581646:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.581654:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.581666:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.581673:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024da0b30/0xc25410d92a3c4e8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.581686:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.581688:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.581689:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.582142:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.582148:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582158:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.582161:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.582165:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582175:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582198:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582204:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582255:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856978.582331:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856978.582337:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.582345:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856978.582348:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.582356:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.582369:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.582386:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4e93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.582403:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.582405:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856978.582408:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.582628:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.582634:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582644:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.582647:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.582651:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582660:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582667:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582674:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.582736:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856978.584632:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.584645:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.584662:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.584666:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.584671:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.584683:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.584692:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.584699:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589329:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856978.589352:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589404:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.589409:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589423:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589448:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589456:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaf9f831/0xc25410d92a3c4e9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589498:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.589503:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589511:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.589514:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589521:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589532:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.589547:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.589549:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.589564:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856978.593641:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787856978.593655:0:18683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ea1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.593764:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856978.594322:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856978.594330:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594350:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1787856978.594367:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856978.594382:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594396:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594410:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594417:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594441:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.594565:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.594573:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.594581:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bba00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.594587:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.594596:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.594615:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.594623:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb441601/0xc25410d92a3c4ea8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.594641:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.594643:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.594645:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856978.594917:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856978.594923:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594932:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1787856978.594936:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856978.594940:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594950:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594970:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.594978:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.595004:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.595127:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.595133:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.595150:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbe00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.595154:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.595162:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.595174:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.595181:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4eaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.595195:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.595196:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.595198:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787856978.605737:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787856978.605754:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.605774:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=512s v=(0 0) 00010000:00010000:2.0:1787856978.605779:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856978.605786:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.605801:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.605812:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.605820:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.605840:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.608787:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.608802:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.608817:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215ba00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.608821:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.608831:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.608864:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.608872:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c06db80/0xc25410d92a3c4eb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.608891:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.608892:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.608894:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787856978.608905:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787856978.608913:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.608924:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=512s v=(0 0) 00010000:00010000:2.0:1787856978.608937:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856978.608944:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.608955:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.608963:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.608970:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.608998:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.609243:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.609249:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.609257:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.609260:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.609267:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.609278:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.609285:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25cfd5a/0xc25410d92a3c4ebd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.609308:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.609310:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.609311:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787856978.610670:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787856978.610693:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.610707:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=512s v=(0 0) 00010000:00010000:2.0:1787856978.610711:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856978.610717:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.610729:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.610739:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.610759:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.610819:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787856978.612031:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787856978.612041:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.612055:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=512s v=(0 0) 00010000:00010000:2.0:1787856978.612059:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856978.612064:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.612076:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.612084:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.612091:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612183:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856978.612191:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612198:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215be00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.612202:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612210:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612240:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612247:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000670558fb/0xc25410d92a3c4ec4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612265:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.612269:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612275:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b400 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.612288:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612296:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612305:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.612313:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.612314:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.612316:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.617997:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787856978.618016:0:18683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f8080b/0xc25410d92a3c4ecb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.618156:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856978.622347:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856978.622502:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.622533:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1787856978.622538:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856978.622546:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.622561:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.622571:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.622579:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.623524:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787856978.623898:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856978.623908:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.623923:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856978.623928:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.623940:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.623964:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.623976:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f11bd0be/0xc25410d92a3c4ed2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.623999:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.624003:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.624005:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856978.624173:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856978.624188:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.624208:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1787856978.624212:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856978.624250:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.624268:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.624279:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.624288:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.624342:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856978.624410:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856978.624419:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.624428:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb400 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856978.624433:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.624443:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.624457:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.624466:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c46f8ba/0xc25410d92a3c4ed9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856978.624490:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.624492:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856978.624494:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856978.625687:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856978.625699:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.625714:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1787856978.625719:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856978.625726:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.625740:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.625749:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.625756:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.625780:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787856978.625930:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856978.625937:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.625945:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007baa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856978.625955:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.625964:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.625979:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.625987:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eccc8759/0xc25410d92a3c4ee0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.626003:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.626004:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.626006:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856978.627349:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856978.627360:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.627383:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1787856978.627400:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856978.627406:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.627420:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.627429:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.627437:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.627465:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787856978.627489:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856978.627496:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.627504:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856978.627508:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.627515:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.627530:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.627543:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082738506/0xc25410d92a3c4ee7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.627560:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.627561:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.627563:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856978.630194:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856978.630210:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.630274:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1787856978.630278:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856978.630285:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.630299:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.630309:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.630330:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.630350:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856978.630403:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856978.630412:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.630423:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856978.630428:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.630438:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.630469:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.630478:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4eee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856978.630499:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856978.630501:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856978.630503:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856978.632788:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856978.632804:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.632820:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1787856978.632824:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856978.632830:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.632842:0:18683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.632851:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.632859:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856978.632884:0:18683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787856978.632959:0:18683:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787856978.633070:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17199:x1874703436419584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98107us (109394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856978.633081:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17199:1874703436419584:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787856978.633090:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:3.0:1787856978.633098:0:17199:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787856978.633140:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17199:1874703436419712:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787856978.633191:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856978.633243:0:17199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5a5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856978.633248:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436419712 00000100:00100000:0.0:1787856978.633254:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436419712 00000100:00100000:0.0:1787856978.633301:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787856978.633311:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17199:x1874703436419712:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787856978.633344:0:18998:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1787856978.633485:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787856978.633493:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.633502:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbe00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787856978.633507:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.633516:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.633535:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.633542:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdefab0/0xc25410d92a3c4ef5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856978.633561:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.633562:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.633564:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856978.642113:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787856978.649065:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787856978.649115:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787856978.649653:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17199:x1874703436419712:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16339us (16456us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787856978.649664:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856978.649860:0:17199:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787856978.649869:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17199:1874703436419712:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787856978.649886:0:17199:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787856979.665568:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856980.691395:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856980.817445:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856980.817470:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436419840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856980.817543:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856980.817766:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436419840 00000100:00100000:3.0:1787856980.817782:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436419840 00000100:00100000:3.0:1787856980.817848:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856980.817858:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436419840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787856980.817888:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787856980.817936:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436419840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856980.817944:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856980.817992:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436419840:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787856980.818057:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856981.329522:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856981.329546:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436419968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787856981.329631:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856981.329723:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436419968 00000100:00100000:3.0:1787856981.329730:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436419968 00000100:00100000:3.0:1787856981.329784:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856981.329793:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436419968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856981.329830:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787856981.329882:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436419968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856981.329890:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856981.329934:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436419968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856981.330082:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436420096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856981.330108:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856981.330188:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436420096 00000100:00100000:2.0:1787856981.330193:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436420096 00000100:00100000:2.0:1787856981.330246:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787856981.330254:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436420096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787856981.330273:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787856981.330310:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436420096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856981.330316:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856981.330438:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436420096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787856981.717588:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787856982.417994:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787856982.737461:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856983.761433:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787856983.889987:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856983.889994:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787856983.889998:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787856983.890006:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1787856983.890010:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787856983.890017:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9066007b3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856983.890037:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a3e940 x1874703436420608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787856983.890070:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856983.890073:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787856983.890074:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787856983.890077:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1787856983.890079:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787856983.890082:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9064c8172000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856983.890092:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90660193de00 x1874703436421120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787856983.890249:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436420224:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890319:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890378:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436420864:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890405:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890426:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436421504:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890456:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890481:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787856983.890487:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436420352:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890512:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890530:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436420992:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890551:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890576:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436420736:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890598:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890615:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436421376:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890638:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890653:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787856983.890658:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436420480:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890679:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890695:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436421248:0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890732:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890754:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436420608:0@lo:8:kworker.0 00000100:00100000:0.0:1787856983.890778:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890793:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90660193de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436421120:0@lo:8:kworker.0 00000100:00100000:0.0:1787856983.890821:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856983.890855:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436420224 00000100:00100000:0.0:1787856983.890861:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436420224 00000100:00100000:0.0:1787856983.890903:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787856983.890911:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3625:x1874703436420224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.890955:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3625:x1874703436420224:12345-0@lo:400:kworker.0 Request processed in 45us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.890962:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787856983.890992:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436420864 00000100:00100000:0.0:1787856983.890995:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436420864 00000100:00100000:0.0:1787856983.891012:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436420352 00000100:00100000:0.0:1787856983.891014:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436420352 00000100:00100000:0.0:1787856983.891025:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787856983.891031:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436420864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.891060:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436420864:12345-0@lo:400:kworker.0 Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.891065:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787856983.891075:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787856983.891081:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436420352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.891105:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436420352:12345-0@lo:400:kworker.0 Request processed in 25us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.891110:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787856983.891125:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436421504 00000100:00100000:0.0:1787856983.891128:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436421504 00000100:00100000:0.0:1787856983.891153:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436420736 00000100:00100000:0.0:1787856983.891156:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436420736 00000100:00100000:0.0:1787856983.891166:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436421376 00000100:00100000:0.0:1787856983.891168:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436421376 00000100:00100000:0.0:1787856983.891190:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436421248 00000100:00100000:0.0:1787856983.891193:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436421248 00000100:00100000:0.0:1787856983.891204:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856983.891208:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436421504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.891258:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436421504:12345-0@lo:400:kworker.0 Request processed in 49us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.891264:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787856983.891274:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787856983.891278:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436420736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.891304:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436420736:12345-0@lo:400:kworker.0 Request processed in 25us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.891310:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787856983.891319:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787856983.891336:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436421376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.891358:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436421376:12345-0@lo:400:kworker.0 Request processed in 34us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.891363:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787856983.891372:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787856983.891376:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436421248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.891395:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874703436421248:12345-0@lo:400:kworker.0 Request processed in 19us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.891400:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787856983.891422:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436420992 00000100:00100000:0.0:1787856983.891425:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436420992 00000100:00100000:0.0:1787856983.891443:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436420480 00000100:00100000:0.0:1787856983.891446:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436420480 00000100:00100000:0.0:1787856983.891454:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436420608 00000100:00100000:0.0:1787856983.891463:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436420608 00000100:00100000:0.0:1787856983.891473:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436421120 00000100:00100000:0.0:1787856983.891475:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436421120 00000100:00100000:0.0:1787856983.891482:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856983.891488:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436420992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.891519:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436420992:12345-0@lo:400:kworker.0 Request processed in 31us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.891525:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856983.891536:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787856983.891541:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436420480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856983.891567:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436420480:12345-0@lo:400:kworker.0 Request processed in 25us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856983.891572:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787856983.891582:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856983.891585:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874703436420608:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787856983.891604:0:18683:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787856983.891791:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787856983.891797:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436421120:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787856983.891807:0:18682:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787856983.891850:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436421120:12345-0@lo:8:kworker.0 Request processed in 52us (1028us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787856983.891864:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787856983.891920:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787856983.891925:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787856983.891929:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436421120:0@lo:8:kworker.0 00000100:00100000:1.0:1787856983.892052:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436421632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856983.892093:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787856983.892144:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856983.892148:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787856983.892150:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856983.892194:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436421632 00000100:00100000:3.0:1787856983.892200:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436421632 00000100:00100000:3.0:1787856983.895445:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856983.895461:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436421632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856983.895495:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787856983.895571:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436421632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856983.895579:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856983.895641:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436421632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856983.898362:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436420480:0@lo:400:kworker.0 00010000:00080000:2.0:1787856983.898386:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193f480 x1874703436421248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856983.898397:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874703436421248:0@lo:400:kworker.0 00010000:00080000:2.0:1787856983.898409:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a3c000 x1874703436420736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856983.898417:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436420736:0@lo:400:kworker.0 00010000:00080000:2.0:1787856983.898458:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193da40 x1874703436421376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856983.898467:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436421376:0@lo:400:kworker.0 00000100:00100000:2.0:1787856983.898518:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436420352:0@lo:400:kworker.0 00000100:00100000:2.0:1787856983.898531:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c6b5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436420992:0@lo:400:kworker.0 00000100:00100000:2.0:1787856983.898555:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436420224:0@lo:400:kworker.0 00000100:00100000:2.0:1787856983.898566:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436420864:0@lo:400:kworker.0 00010000:00080000:2.0:1787856983.898582:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90660193e940 x1874703436421504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856983.898590:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90660193e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436421504:0@lo:400:kworker.0 00000100:00080000:2.0:1787856983.925293:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856983.925315:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787856983.925320:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436420608:0@lo:8:kworker.0 00000100:00100000:0.0:1787856983.932654:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874703436420608:12345-0@lo:8:kworker.0 Request processed in 40709us (41517us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787856983.932674:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000004:2.0:1787856984.275724:0:19494:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787856984.275728:0:19494:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787856984.275730:0:19494:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787856984.275842:0:19494:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9064c10ae000 00000020:01000004:2.0:1787856984.275859:0:19494:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787856984.275873:0:19494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787856984.275897:0:19494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9064c7a60000) 00000020:00000080:2.0:1787856984.275917:0:19494:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787856984.374126:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787856984.375099:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787856984.375578:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787856984.375767:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787856984.375960:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787856984.376155:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787856984.376587:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1787856984.386366:0:19494:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787856984.386605:0:19494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787856984.386622:0:19494:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787856984.386639:0:19494:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc25410d92a3c4f03 00000020:01000004:2.0:1787856984.386648:0:19494:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787856984.386675:0:19494:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787856984.386679:0:19494:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787856984.386685:0:19494:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787856984.386717:0:19494:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787856984.386722:0:19494:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787856984.400458:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787856984.400500:0:19494:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.106@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787856984.400505:0:19494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787856984.400507:0:19494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787856984.400508:0:19494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856984.400509:0:19494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856984.400511:0:19494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856984.400512:0:19494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856984.400514:0:19494:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856984.400516:0:19494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856984.400518:0:19494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787856984.400521:0:19494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787856984.400524:0:19494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787856984.400525:0:19494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787856984.400527:0:19494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856984.400528:0:19494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856984.400529:0:19494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856984.400530:0:19494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856984.400537:0:19494:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856984.400538:0:19494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856984.400539:0:19494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787856984.400566:0:19494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787856984.400585:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436421760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787856984.400660:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.400787:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.400923:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436421760 00000100:00100000:0.0:1787856984.400932:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436421760 00000100:00100000:0.0:1787856984.401027:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787856984.401037:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:19494:x1874703436421760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787856984.401082:0:17166:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787856984.401086:0:17166:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787856984.401090:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787856984.401481:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:19494:x1874703436421760:12345-0@lo:253:mount.lustre.0 Request processed in 445us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.401496:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787856984.401607:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436421760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787856984.401618:0:19494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787856984.401620:0:19494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787856984.401621:0:19494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787856984.401623:0:19494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856984.401623:0:19494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856984.401624:0:19494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856984.401625:0:19494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856984.401626:0:19494:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856984.401628:0:19494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856984.401629:0:19494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787856984.401646:0:19494:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9064c10ae000 from lustre-OST0001 10000000:01000000:1.0:1787856984.401673:0:19494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787856984.401676:0:19494:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787856984.401685:0:19494:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9065fe710000 local copy 00010000:00010000:1.0:1787856984.401695:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856984.401772:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436421888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856984.401804:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.402004:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856984.402069:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436421888 00000100:00100000:2.0:1787856984.402074:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436421888 00000100:00100000:0.0:1787856984.402191:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787856984.402199:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:19494:x1874703436421888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856984.402423:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:19494:x1874703436421888:12345-0@lo:501:mount.lustre.0 Request processed in 223us (617us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787856984.402432:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787856984.402553:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436421888:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787856984.402567:0:19494:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787856984.402585:0:19494:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787856984.402601:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856984.402610:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215a600/0xc25410d92a3c4b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4b59 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856984.402637:0:19494:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9064c10ae000 10000000:01000000:1.0:1787856984.402641:0:19494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787856984.402646:0:19494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787856984.402649:0:19494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787856984.402653:0:19494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787856984.402656:0:19494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787856984.402679:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938c00/0xc25410d92a3c4f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856984.402687:0:19494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601938c00/0xc25410d92a3c4f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856984.402696:0:19494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601938c00/0xc25410d92a3c4f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856984.402710:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787856984.402737:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.402756:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787856984.402839:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436422016 00000100:00100000:2.0:1787856984.402844:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436422016 00000100:00100000:2.0:1787856984.402868:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787856984.402876:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:19494:x1874703436422016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856984.402884:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856984.402898:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660215be00/0xc25410d92a3c4f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4f0a expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856984.402922:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215be00/0xc25410d92a3c4f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4f0a expref: 22 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856984.402934:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660215be00/0xc25410d92a3c4f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4f0a expref: 22 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856984.402942:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215be00, rc 0) 00000100:00100000:2.0:1787856984.402983:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422016:12345-0@lo:101:mount.lustre.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856984.402989:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787856984.403058:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856984.403071:0:19494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601938c00/0xc25410d92a3c4f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f11 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856984.403080:0:19494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601938c00/0xc25410d92a3c4f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4f11 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856984.404125:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787856984.404749:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856984.406921:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787856984.406976:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787856984.406992:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787856984.407006:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787856984.407020:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787856984.407035:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787856984.407060:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787856984.407066:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787856984.407166:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856984.407398:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.407494:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787856984.407540:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436422144 00000100:00100000:2.0:1787856984.407546:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436422144 00000100:00100000:2.0:1787856984.407633:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787856984.407652:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856984.407801:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422144:12345-0@lo:501:mount.lustre.0 Request processed in 151us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856984.407809:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787856984.407880:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856984.407915:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787856984.407953:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.408064:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.408155:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436422272 00000100:00100000:0.0:1787856984.408161:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436422272 00000100:00100000:0.0:1787856984.408187:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787856984.408194:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787856984.408969:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422272:12345-0@lo:503:mount.lustre.0 Request processed in 773us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.408977:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787856984.409082:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787856984.409511:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856984.409586:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856984.409631:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.409659:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.409919:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436422400 00000100:00100000:0.0:1787856984.409924:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436422400 00000100:00100000:0.0:1787856984.409952:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787856984.409958:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856984.410361:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422400:12345-0@lo:502:mount.lustre.0 Request processed in 401us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.410369:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787856984.410522:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856984.410724:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787856984.410756:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787856984.410787:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787856984.410802:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787856984.410816:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787856984.410833:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787856984.410847:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787856984.410859:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787856984.410870:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787856984.410896:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856984.410939:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.410963:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.411084:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436422528 00000100:00100000:0.0:1787856984.411089:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436422528 00000100:00100000:0.0:1787856984.411114:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787856984.411121:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856984.411203:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422528:12345-0@lo:502:mount.lustre.0 Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.411245:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787856984.411460:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856984.411511:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787856984.411524:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787856984.412199:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787856984.412210:0:19498:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787856984.412259:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.412262:0:19498:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787856984.412281:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787856984.412296:0:19498:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9064c7860000) 00000020:00000080:1.0:1787856984.412339:0:19498:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787856984.412346:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787856984.412419:0:19498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9064c10ae000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787856984.412427:0:19498:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787856984.412433:0:19498:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc25410d92a3c4f1f 00010000:00010000:1.0:1787856984.415808:0:19498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787856984.416187:0:19498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787856984.417493:0:19498:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787856984.418730:0:19498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787856984.418740:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856984.418746:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.418752:0:19498:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787856984.418756:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856984.418760:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.418761:0:19498:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787856984.418764:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787856984.418766:0:19498:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787856984.418768:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856984.418770:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.418772:0:19498:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787856984.418774:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856984.418776:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.418778:0:19498:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787856984.418781:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787856984.418805:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856984.418808:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.418810:0:19498:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787856984.418813:0:19498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787856984.421405:0:19494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787856984.421454:0:19494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787856984.421484:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938c00/0xc25410d92a3c4f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f11 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.421499:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601938c00/0xc25410d92a3c4f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f11 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856984.421507:0:19494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9064c10ae000 from 1 10000000:01000000:3.0:1787856984.421511:0:19494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787856984.421547:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.421555:0:19494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.421574:0:19494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856984.421599:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787856984.421669:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856984.421720:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7194900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.422435:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436422656 00000100:00100000:0.0:1787856984.422446:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436422656 00000100:00100000:0.0:1787856984.423673:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787856984.423687:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:19494:x1874703436422656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787856984.423704:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856984.423719:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4f26 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.423747:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.423758:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.423768:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb200, rc 0) 00000100:00100000:0.0:1787856984.423843:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436422656:12345-0@lo:101:mount.lustre.0 Request processed in 160us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.423851:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787856984.423934:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422656:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856984.423951:0:19494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856984.423961:0:19494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856984.425270:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787856984.425670:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856984.425879:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787856984.425908:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787856984.425930:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787856984.425936:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787856984.426006:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856984.426068:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.426277:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcb840 going to sleep for 11 seconds 00000100:00100000:2.0:1787856984.428418:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436422784 00000100:00100000:2.0:1787856984.428430:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436422784 00000100:00100000:2.0:1787856984.428490:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787856984.428501:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436422784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856984.428669:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436422784:12345-0@lo:501:mount.lustre.0 Request processed in 169us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856984.428677:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787856984.429028:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856984.429079:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787856984.429129:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.429213:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcb840 going to sleep for 11 seconds 00000100:00100000:3.0:1787856984.429423:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436422912 00000100:00100000:3.0:1787856984.429429:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436422912 00000100:00100000:2.0:1787856984.429496:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787856984.429505:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436422912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856984.429643:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436422912:12345-0@lo:503:mount.lustre.0 Request processed in 139us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856984.429651:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787856984.429789:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436422912:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787856984.430457:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787856984.430538:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856984.430589:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.430662:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcb840 going to sleep for 11 seconds 00000100:00100000:2.0:1787856984.430699:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436423040 00000100:00100000:2.0:1787856984.430704:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436423040 00000100:00100000:2.0:1787856984.430769:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787856984.430778:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436423040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856984.430873:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436423040:12345-0@lo:502:mount.lustre.0 Request processed in 95us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856984.430880:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787856984.430944:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856984.431114:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787856984.431140:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787856984.431151:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787856984.431162:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787856984.431173:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787856984.431183:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787856984.431194:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787856984.431205:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787856984.431248:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787856984.431281:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787856984.431296:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787856984.431340:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856984.431376:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.431604:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c7bcb840 going to sleep for 11 seconds 00000100:00100000:3.0:1787856984.431690:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436423168 00000100:00100000:3.0:1787856984.431695:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436423168 00000100:00100000:3.0:1787856984.431723:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787856984.431731:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436423168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787856984.431823:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436423168:12345-0@lo:502:mount.lustre.0 Request processed in 92us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856984.431832:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787856984.431907:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856984.431949:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787856984.431965:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787856984.433819:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856984.433833:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.433836:0:19502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787856984.433847:0:19502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9064c10ae000 00000020:00000080:1.0:1787856984.433850:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787856984.433860:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856984.433863:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.433864:0:19502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787856984.433866:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856984.433869:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.433870:0:19502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787856984.433874:0:19502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9064c10ae000 00000020:00000080:1.0:1787856984.433876:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787856984.433954:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856984.433958:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.433960:0:19502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787856984.433962:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856984.433965:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.433966:0:19502:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787856984.433969:0:19502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9064c10ae000 00000020:00000080:1.0:1787856984.433971:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787856984.433988:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856984.433991:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.433992:0:19502:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787856984.433994:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787856984.433996:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.433997:0:19502:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787856984.434000:0:19502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9064c10ae000 00000020:00000080:1.0:1787856984.434001:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787856984.434019:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787856984.434021:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787856984.434023:0:19502:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787856984.434025:0:19502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787856984.437499:0:19494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787856984.437548:0:19494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787856984.437571:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856984.437592:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856984.437671:0:19494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787856984.437674:0:19494:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9064c10ae000 10000000:01000000:2.0:1787856984.437677:0:19494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9064c10ae000 10000000:01000000:2.0:1787856984.437682:0:19494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787856984.437687:0:19494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9064c10ae000 from 1 10000000:01000000:2.0:1787856984.437689:0:19494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787856984.437727:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215b400/0xc25410d92a3c4f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856984.437736:0:19494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215b400/0xc25410d92a3c4f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856984.437746:0:19494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215b400/0xc25410d92a3c4f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856984.437772:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787856984.437841:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856984.437890:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.441546:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436423296 00000100:00100000:0.0:1787856984.441560:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436423296 00000100:00100000:0.0:1787856984.441627:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787856984.441636:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436423296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787856984.441651:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856984.441668:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007ba400/0xc25410d92a3c4f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4f34 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.441694:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007ba400/0xc25410d92a3c4f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4f34 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.441712:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007ba400/0xc25410d92a3c4f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4f34 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.441721:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba400, rc 0) 00000100:00100000:0.0:1787856984.441794:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423296:12345-0@lo:101:mount.lustre.0 Request processed in 159us (3954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.441800:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787856984.441923:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856984.441942:0:19494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215b400/0xc25410d92a3c4f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f3b expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856984.441951:0:19494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215b400/0xc25410d92a3c4f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4f3b expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856984.443197:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1787856984.443498:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787856984.443694:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787856984.443717:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787856984.443729:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787856984.443740:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787856984.443750:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787856984.443761:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787856984.443773:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787856984.443799:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787856984.443815:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787856984.443829:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787856984.443842:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787856984.443854:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787856984.443867:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787856984.443879:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787856984.443892:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787856984.443902:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787856984.443914:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787856984.443926:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787856984.443938:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787856984.443951:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787856984.443963:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787856984.443973:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787856984.443983:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787856984.444005:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787856984.444017:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787856984.444028:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787856984.444039:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787856984.444049:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787856984.444059:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787856984.444077:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787856984.444088:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787856984.444098:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787856984.444108:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787856984.444119:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787856984.444129:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787856984.444139:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787856984.444149:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787856984.444160:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787856984.444170:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1787856984.444190:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1787856984.444201:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1787856984.444211:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1787856984.444252:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1787856984.444263:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1787856984.444274:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1787856984.444284:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1787856984.444301:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1787856984.444305:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1787856984.444393:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856984.444455:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856984.444489:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.444661:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436423424 00000100:00100000:0.0:1787856984.444668:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436423424 00000100:00100000:0.0:1787856984.444720:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787856984.444729:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856984.444848:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423424:12345-0@lo:501:mount.lustre.0 Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.444856:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787856984.445866:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856984.445917:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856984.445970:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856984.445996:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.446411:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436423552 00000100:00100000:0.0:1787856984.446417:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436423552 00000100:00100000:0.0:1787856984.446458:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787856984.446467:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787856984.446569:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423552:12345-0@lo:503:mount.lustre.0 Request processed in 102us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.446578:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787856984.446628:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423552:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787856984.447015:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787856984.447102:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856984.447140:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.447186:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.447206:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436423680 00000100:00100000:0.0:1787856984.447211:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436423680 00000100:00100000:0.0:1787856984.447266:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787856984.447273:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856984.448512:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423680:12345-0@lo:502:mount.lustre.0 Request processed in 1235us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.448523:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787856984.448585:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787856984.448797:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787856984.448847:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787856984.448862:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787856984.448876:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787856984.448887:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787856984.448898:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787856984.448910:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787856984.448922:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787856984.448934:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787856984.448946:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787856984.448956:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787856984.448968:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787856984.448979:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787856984.448991:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787856984.449004:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787856984.449018:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787856984.449043:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787856984.449057:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787856984.449070:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787856984.449083:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787856984.449095:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787856984.449119:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787856984.449132:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787856984.449143:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787856984.449153:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787856984.449164:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787856984.449173:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787856984.449184:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787856984.449194:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787856984.449204:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787856984.449234:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787856984.449248:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787856984.449269:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787856984.449281:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787856984.449291:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787856984.452449:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787856984.452502:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787856984.452518:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787856984.452534:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787856984.452546:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787856984.452558:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787856984.452569:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787856984.452583:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787856984.452598:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787856984.452612:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787856984.452623:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787856984.452638:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787856984.452651:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787856984.452730:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856984.452810:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.452859:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.452956:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436423808 00000100:00100000:0.0:1787856984.452962:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436423808 00000100:00100000:0.0:1787856984.453013:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787856984.453021:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856984.453122:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423808:12345-0@lo:502:mount.lustre.0 Request processed in 101us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.453130:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787856984.453180:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787856984.454481:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787856984.454529:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787856984.454567:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856984.454627:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.454662:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f7378a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.454688:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436423936 00000100:00100000:0.0:1787856984.454694:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436423936 00000100:00100000:0.0:1787856984.454734:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787856984.454742:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856984.454835:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436423936:12345-0@lo:502:mount.lustre.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.454842:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787856984.454896:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436423936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787856984.454936:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787856984.454943:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787856984.456896:0:19507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787856984.456913:0:19507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9064c7a619d0) 00000020:00000080:2.0:1787856984.456936:0:19507:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787856984.457020:0:19507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9064c10ae000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787856984.457027:0:19507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9064c10ae000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787856984.457030:0:19507:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9064c10ae000 3 00010000:00080000:2.0:1787856984.457057:0:19507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9064c78b7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1787856984.458856:0:19507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787856984.459040:0:19507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787856984.459078:0:19507:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787856984.459088:0:19507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc25410d92a3c4f49 00000100:00080000:2.0:1787856984.459097:0:19507:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787856984.459103:0:19507:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9064c78b7000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1787856984.459134:0:19507:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9064c826c000 x1874703436424064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787856984.459167:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436424064:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787856984.459245:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787856984.459291:0:19507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787856984.460874:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436424064 00000100:00100000:0.0:1787856984.460884:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436424064 00000100:00100000:0.0:1787856984.460923:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787856984.460931:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874703436424064:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787856984.460957:0:17175:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:0.0:1787856984.460993:0:17175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc25410d92a3c4f50 00000004:00100000:0.0:1787856984.461008:0:17175:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787856984.461038:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9064c79b1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856984.461105:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874703436424064:12345-0@lo:38:llog_process_th.0 Request processed in 174us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.461113:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787856984.461235:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9064c826c000 x1874703436424064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856984.461246:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787856984.461253:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787856984.461260:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787856984.461264:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787856984.461266:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c78b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787856984.461272:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c826c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874703436424064:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787856984.462456:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856984.462461:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787856984.462464:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787856984.462469:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1787856984.462473:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787856984.462478:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9066007b3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856984.462494:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a2e940 x1874703436424448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787856984.462533:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787856984.462536:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787856984.462543:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787856984.462546:0:14203:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1787856984.462548:0:14203:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787856984.462552:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9064c8172000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1787856984.462563:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a2fc00 x1874703436424960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787856984.462604:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436424704:0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.462654:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.462682:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436425344:0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.462705:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.462727:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787856984.462732:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436424576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.462764:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.462780:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436425216:0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.462798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.462825:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436424704 00000100:00100000:0.0:1787856984.462831:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436424704 00000100:00100000:0.0:1787856984.462867:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787856984.462873:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436424704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.462912:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436424704:12345-0@lo:400:kworker.0 Request processed in 38us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.462919:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787856984.462935:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436425344 00000100:00100000:0.0:1787856984.462938:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436425344 00000100:00100000:0.0:1787856984.462952:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436424576 00000100:00100000:0.0:1787856984.462954:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436424576 00000100:00100000:0.0:1787856984.462970:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436425216 00000100:00100000:0.0:1787856984.462972:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436425216 00000100:00100000:0.0:1787856984.462981:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787856984.462986:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436425344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.463021:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436425344:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.463027:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787856984.463037:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787856984.463042:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436424576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.463061:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874703436424576:12345-0@lo:400:kworker.0 Request processed in 19us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.463066:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787856984.463074:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856984.463079:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436425216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.463096:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874703436425216:12345-0@lo:400:kworker.0 Request processed in 17us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.463101:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787856984.463119:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436424448:0@lo:8:kworker.0 00000100:00100000:0.0:1787856984.463138:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.463153:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436424960:0@lo:8:kworker.0 00000100:00100000:0.0:1787856984.463167:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.463188:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436424448 00000100:00100000:0.0:1787856984.463191:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436424448 00000100:00100000:0.0:1787856984.463204:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436424960 00000100:00100000:0.0:1787856984.463206:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436424960 00000100:00100000:0.0:1787856984.463234:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856984.463238:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436424448:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787856984.463285:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436424448:12345-0@lo:8:kworker.0 Request processed in 46us (146us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787856984.463291:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787856984.463426:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436424192:0@lo:400:kworker.0 00000100:00100000:2.0:1787856984.463458:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856984.463478:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436424832:0@lo:400:kworker.0 00000100:00100000:2.0:1787856984.463500:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856984.463513:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787856984.463517:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436424320:0@lo:400:kworker.0 00000100:00100000:2.0:1787856984.463537:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856984.463546:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436425088:0@lo:400:kworker.0 00000100:00100000:2.0:1787856984.463564:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856984.464460:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436424192 00000100:00100000:3.0:1787856984.464468:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436424192 00000100:00100000:0.0:1787856984.464540:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436424832 00000100:00100000:0.0:1787856984.464544:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436424832 00000100:00100000:3.0:1787856984.466739:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787856984.466754:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436424192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856984.466900:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436424192:12345-0@lo:400:kworker.0 Request processed in 150us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856984.466908:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787856984.466944:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436424192:0@lo:400:kworker.0 00000100:00100000:1.0:1787856984.467285:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436424320 00000100:00100000:1.0:1787856984.467293:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436424320 00000100:00100000:0.0:1787856984.467890:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856984.467903:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436424832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.467960:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436424832:12345-0@lo:400:kworker.0 Request processed in 63us (4460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.467967:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856984.467982:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787856984.467987:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436424960:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787856984.468032:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436424960:12345-0@lo:8:kworker.0 Request processed in 43us (4863us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787856984.468037:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787856984.468083:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436425088 00000100:00100000:0.0:1787856984.468088:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436425088 00000100:00100000:0.0:1787856984.468114:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787856984.468121:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436425088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.468151:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436425088:12345-0@lo:400:kworker.0 Request processed in 30us (4585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.468157:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787856984.468192:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a2f480 x1874703436425088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856984.468205:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436425088:0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.468244:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436424832:0@lo:400:kworker.0 00000100:00100000:0.0:1787856984.468298:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787856984.468305:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856984.468309:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787856984.468313:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436424448:0@lo:8:kworker.0 00000100:00100000:0.0:1787856984.468333:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787856984.468336:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787856984.468339:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787856984.468342:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436424960:0@lo:8:kworker.0 00000100:00100000:1.0:1787856984.468614:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856984.468622:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436424320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856984.468665:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436424320:12345-0@lo:400:kworker.0 Request processed in 44us (5127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856984.468671:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856984.468715:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436424320:0@lo:400:kworker.0 00010000:00080000:1.0:1787856984.468742:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a2e1c0 x1874703436424576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856984.468751:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874703436424576:0@lo:400:kworker.0 00010000:00080000:1.0:1787856984.468762:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a2f0c0 x1874703436425216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856984.468770:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874703436425216:0@lo:400:kworker.0 00000100:00100000:1.0:1787856984.468782:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436424704:0@lo:400:kworker.0 00010000:00080000:1.0:1787856984.468792:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a2e580 x1874703436425344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856984.468800:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436425344:0@lo:400:kworker.0 00000020:01000004:1.0:1787856984.468975:0:19507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787856984.468992:0:19507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9065fbf933a0) 00000020:00000080:1.0:1787856984.469012:0:19507:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787856984.469084:0:19507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9064c10ae000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787856984.469088:0:19507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9064c10ae000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787856984.469089:0:19507:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9064c10ae000 3 00010000:00080000:1.0:1787856984.469119:0:19507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9064c88ce800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1787856984.471983:0:19507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1787856984.472209:0:19507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787856984.472285:0:19507:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787856984.472309:0:19507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc25410d92a3c4f5e 00000100:00080000:1.0:1787856984.472327:0:19507:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787856984.472334:0:19507:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9064c88ce800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856984.472368:0:19507:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a78b40 x1874703436425472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856984.472390:0:19507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1787856984.472772:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:0.0:1787856984.473312:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874703436425472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787856984.473393:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787856984.473452:0:19494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787856984.473485:0:19494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787856984.473500:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215b400/0xc25410d92a3c4f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f3b expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.473511:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215b400/0xc25410d92a3c4f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f3b expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787856984.473561:0:19494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787856984.473563:0:19494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787856984.473564:0:19494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856984.473565:0:19494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856984.473566:0:19494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856984.473568:0:19494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856984.473569:0:19494:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787856984.473571:0:19494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856984.473573:0:19494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787856984.473577:0:19494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787856984.473579:0:19494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787856984.473585:0:19494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787856984.473586:0:19494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856984.473587:0:19494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856984.473588:0:19494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856984.473589:0:19494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856984.473590:0:19494:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787856984.473591:0:19494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856984.473592:0:19494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787856984.473609:0:19494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787856984.473623:0:19494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436425600:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787856984.473658:0:19494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.473681:0:19494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c79d59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856984.473688:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436425600 00000100:00100000:3.0:1787856984.473694:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436425600 00000100:00100000:3.0:1787856984.473740:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787856984.473748:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:19494:x1874703436425600:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787856984.473858:0:17166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787856984.473875:0:17166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787856984.475128:0:17166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787856984.475139:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787856984.475191:0:17190:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787856984.475195:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787856984.475213:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475248:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 24 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475256:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475263:0:17190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475292:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475314:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 24 pid: 17167 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856984.475349:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436425728:0@lo:104: 00000100:00100000:0.0:1787856984.475398:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787856984.475440:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 24 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475449:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 24 pid: 17168 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856984.475457:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436425856:0@lo:104: 00000100:00100000:0.0:1787856984.475477:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.475491:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c79d5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856984.475509:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436425728 00000100:00100000:0.0:1787856984.475514:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436425728 00000100:00100000:0.0:1787856984.475542:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436425856 00000100:00100000:0.0:1787856984.475545:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436425856 00000100:00100000:0.0:1787856984.475558:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787856984.475564:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+4:17190:x1874703436425728:12345-0@lo:104: 00010000:00010000:0.0:1787856984.475575:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475619:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787856984.475625:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+4:17190:x1874703436425728:12345-0@lo:104: Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.475632:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787856984.475649:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787856984.475656:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436425856:12345-0@lo:104: 00010000:00010000:0.0:1787856984.475662:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475705:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787856984.475711:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:17190:x1874703436425856:12345-0@lo:104: Request processed in 56us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856984.475717:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787856984.475731:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856984.475731:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856984.475736:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475743:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787856984.475747:0:17162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475756:0:17162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856984.475763:0:17162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856984.475769:0:17162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787856984.475789:0:17162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475795:0:17162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856984.475826:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856984.475833:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c4e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4e15 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856984.475840:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787856984.475851:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436425984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856984.475854:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856984.475856:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856984.475858:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856984.475881:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856984.475883:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436425728:0@lo:104: 00000100:00100000:0.0:1787856984.475891:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17190:1874703436425856:0@lo:104: 00000100:00100000:3.0:1787856984.475908:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436425984 00010000:00010000:0.0:1787856984.475909:0:17190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856984.475925:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436425984 00010000:00010000:3.0:1787856984.475944:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 25 pid: 17168 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856984.475965:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856984.475971:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+25:3624:x1874703436425984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856984.475982:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856984.475987:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 25 pid: 17168 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.475996:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 25 pid: 17168 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.476008:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660215bc00/0xc25410d92a3c4e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4e0e expref: 25 pid: 17168 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.476019:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856984.476044:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3624:x1874703436425984:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856984.476051:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856984.476077:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436425984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856984.478839:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:19494:x1874703436425600:12345-0@lo:253:mount.lustre.0 Request processed in 5084us (5172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856984.478857:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787856984.478932:0:19494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:19494:1874703436425600:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787856984.478947:0:19494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787856984.478950:0:19494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787856984.478951:0:19494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787856984.478953:0:19494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787856984.478954:0:19494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787856984.478955:0:19494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787856984.478956:0:19494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787856984.478958:0:19494:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787856984.478959:0:19494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787856984.478961:0:19494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787856984.478975:0:19494:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787856984.479951:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436425472 00000100:00100000:1.0:1787856984.479959:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436425472 00010000:00010000:3.0:1787856984.479969:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856984.479978:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.479988:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601938000 already unused, calling callback (ffffffffc1414c20) 00000100:00100000:1.0:1787856984.479988:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 10000000:00010000:3.0:1787856984.479992:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856984.479995:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874703436425472:12345-0@lo:38:llog_process_th.0 00010000:00010000:3.0:1787856984.480001:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787856984.480008:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856984.480014:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00080000:1.0:1787856984.480022:0:17176:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00010000:00010000:3.0:1787856984.480043:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480049:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1787856984.480050:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc25410d92a3c4f6c 00010000:00010000:3.0:1787856984.480063:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:1.0:1787856984.480064:0:17176:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:3.0:1787856984.480070:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601938000/0xc25410d92a3c4e1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4e23 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480084:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856984.480086:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856984.480087:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787856984.480092:0:17176:0:(import.c:65:import_set_state_nolock()) ffff9064c88cb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856984.480106:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436426112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787856984.480657:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856984.480682:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874703436425472:12345-0@lo:38:llog_process_th.0 Request processed in 685us (7288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856984.480690:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856984.480703:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436426112 00000100:00100000:3.0:1787856984.480708:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436426112 00010000:00010000:3.0:1787856984.480728:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 23 pid: 17167 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787856984.480735:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff906601a78b40 x1874703436425472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856984.480746:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787856984.480747:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856984.480752:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:3624:x1874703436426112:12345-0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787856984.480753:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787856984.480761:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00010000:00010000:3.0:1787856984.480762:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856984.480767:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 23 pid: 17167 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480777:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 23 pid: 17167 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480790:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4e1c expref: 23 pid: 17167 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480803:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480813:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787856984.480827:0:17159:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010881612s 00010000:00010000:3.0:1787856984.480831:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787856984.480835:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00010000:00010000:3.0:1787856984.480838:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787856984.480838:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c88ce800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787856984.480844:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874703436425472:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1787856984.480853:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480859:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480865:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856984.480868:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480876:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480904:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856984.480915:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856984.480946:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:3624:x1874703436426112:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856984.480952:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856984.480982:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436426112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787856984.480997:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856984.480999:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787856984.481413:0:19494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787856984.481588:0:17190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856984.481598:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856984.481604:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9066007ba000/0xc25410d92a3c4f65 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787856984.483717:0:19494:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787856984.483726:0:19494:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787856984.483763:0:19494:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787856984.483802:0:19494:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787856984.483817:0:19494:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787856984.483837:0:19494:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787856984.484723:0:19494:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787856984.484948:0:19494:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787856984.785421:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787856985.499570:0:19562:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787856985.499848:0:19562:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787856985.809854:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856985.938138:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856985.938169:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436426240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856985.938296:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856985.943518:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436426240 00000100:00100000:3.0:1787856985.943538:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436426240 00000100:00100000:3.0:1787856985.943649:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787856985.943673:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436426240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787856985.943789:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787856985.943975:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436426240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 310us (5676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856985.943991:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:0.0:1787856985.944318:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787856985.944324:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065fe85c800 from 10 10000000:01000000:0.0:1787856985.944328:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787856985.944395:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007bbe00/0xc25410d92a3c4f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856985.944407:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9066007bbe00/0xc25410d92a3c4f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856985.944427:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9066007bbe00/0xc25410d92a3c4f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856985.944469:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436426368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787856985.944527:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856985.944572:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c78e4e40 going to sleep for 11 seconds 00000100:00080000:1.0:1787856985.945201:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856985.945302:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436426240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787856985.945721:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436426368 00000100:00100000:3.0:1787856985.945730:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436426368 00000100:00100000:3.0:1787856985.945786:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787856985.945797:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:17170:x1874703436426368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856985.945815:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856985.945839:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4f73 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.945874:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4f73 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.945886:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5fe800/0xc25410d92a3c4f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4f73 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.945896:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe800, rc 0) 00000100:00100000:3.0:1787856985.945975:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436426368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856985.945982:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787856985.946053:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436426368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787856985.946074:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9066007bbe00/0xc25410d92a3c4f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f7a expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856985.946104:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9066007bbe00/0xc25410d92a3c4f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4f7a expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856985.946170:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a783c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436426496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787856985.946209:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856985.946331:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c85f50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856985.946559:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436426496 00000100:00100000:3.0:1787856985.946565:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436426496 00000100:00100000:3.0:1787856985.946598:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787856985.946605:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436426496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787856985.946623:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787856985.946645:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787856985.946653:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787856985.946750:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436426496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856985.946759:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787856985.946804:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a783c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436426496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787856985.946883:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787856985.946893:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9066007bbe00/0xc25410d92a3c4f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f7a expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.946904:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9066007bbe00/0xc25410d92a3c4f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f7a expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856985.946916:0:17170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787856985.946919:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9065c52b7000 from 10 10000000:01000000:3.0:1787856985.946922:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787856985.946948:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c4f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.946955:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c4f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.946964:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c4f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856985.946981:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436426624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787856985.947012:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856985.947027:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb7603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856985.947040:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436426624 00000100:00100000:3.0:1787856985.947044:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436426624 00000100:00100000:3.0:1787856985.947076:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787856985.947083:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436426624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856985.947092:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856985.947106:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c4f81 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.947126:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c4f81 expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.947135:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065fd5fe000/0xc25410d92a3c4f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4f81 expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.947143:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fe000, rc 0) 00000100:00100000:3.0:1787856985.947173:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:17170:x1874703436426624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856985.947181:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787856985.947214:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436426624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856985.947258:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c4f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f88 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856985.947269:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c4f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c4f88 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856985.947326:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436426752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787856985.947361:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856985.947384:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb7603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856985.947397:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436426752 00000100:00100000:3.0:1787856985.947401:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436426752 00000100:00100000:3.0:1787856985.947433:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787856985.947439:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:17170:x1874703436426752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787856985.947451:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787856985.950754:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787856985.950768:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787856985.951068:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:17170:x1874703436426752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3621us (3699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856985.951083:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787856985.956815:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436426752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787856985.957074:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787856985.957098:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c4f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f88 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856985.957114:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe600/0xc25410d92a3c4f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c4f88 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856986.258049:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787856986.459667:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787856986.459699:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436426880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856986.459795:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856986.459845:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787856986.459853:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436427008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856986.459878:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856986.459911:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436426880 00000100:00100000:2.0:1787856986.459921:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436426880 00000100:00100000:2.0:1787856986.459977:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436427008 00000100:00100000:2.0:1787856986.459980:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436427008 00000100:00100000:2.0:1787856986.459997:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787856986.460006:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436426880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787856986.460047:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787856986.460100:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436426880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856986.460107:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787856986.460143:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787856986.460150:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436427008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787856986.460169:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787856986.460248:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436427008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856986.460254:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787856986.460321:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436427008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856986.460357:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436426880:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787856986.834483:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856987.866622:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856988.882087:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856989.023111:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436427136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856989.023196:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856989.023377:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436427136 00000100:00100000:0.0:1787856989.023385:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436427136 00000100:00100000:0.0:1787856989.023461:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787856989.023471:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436427136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856989.023659:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787856989.025750:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436427136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2272us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856989.025768:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787856989.025806:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856989.026009:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436427136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787856989.528528:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856989.528536:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787856989.528539:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856989.528552:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9066007b3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856989.528573:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff906601a7b840 x1874703436427648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787856989.528606:0:14203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856989.528609:0:14203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787856989.528610:0:14203:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856989.528614:0:14203:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9064c8172000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1787856989.528624:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9065d2759a40 x1874703436428160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787856989.528903:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436427520:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.528967:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.528998:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436428288:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.529020:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.529038:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436428800:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.529064:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.529090:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787856989.529096:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436427776:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.529116:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.529132:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436428416:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.529151:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.529171:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436427392:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.529196:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.529247:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436428032:0@lo:400:kworker.0 00000100:00100000:0.0:1787856989.529494:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436428288 00000100:00100000:0.0:1787856989.529502:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436428288 00000100:00100000:0.0:1787856989.529539:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436428800 00000100:00100000:0.0:1787856989.529542:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436428800 00000100:00100000:0.0:1787856989.529566:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436427776 00000100:00100000:0.0:1787856989.529568:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436427776 00000100:00100000:0.0:1787856989.529580:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436428416 00000100:00100000:0.0:1787856989.529582:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436428416 00000100:00100000:0.0:1787856989.529597:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787856989.529605:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436428288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856989.529657:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436428288:12345-0@lo:400:kworker.0 Request processed in 52us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856989.529675:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787856989.531869:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.531946:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436428672:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.531986:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.532012:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787856989.532019:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3626:1874703436427264:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.532048:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.532087:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436427904:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.532114:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.532135:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436428544:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.532157:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.532202:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436427520 00000100:00100000:3.0:1787856989.532210:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436427520 00000100:00100000:0.0:1787856989.532370:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436428672 00000100:00100000:0.0:1787856989.532375:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436428672 00000100:00100000:0.0:1787856989.532406:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436428544 00000100:00100000:0.0:1787856989.532409:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436428544 00000100:00100000:0.0:1787856989.532427:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787856989.532435:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436428800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856989.532490:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436428800:12345-0@lo:400:kworker.0 Request processed in 55us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856989.532498:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787856989.532516:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787856989.532523:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436427776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856989.532552:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436427776:12345-0@lo:400:kworker.0 Request processed in 30us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856989.532558:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787856989.532569:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787856989.532575:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436428416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856989.532604:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436428416:12345-0@lo:400:kworker.0 Request processed in 30us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856989.532611:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787856989.532622:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787856989.532628:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436428672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856989.532661:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436428672:12345-0@lo:400:kworker.0 Request processed in 33us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856989.532668:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787856989.535509:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436428032 00000100:00100000:3.0:1787856989.535522:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436428032 00000100:00100000:3.0:1787856989.535576:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856989.535585:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436427520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.535669:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436427520:12345-0@lo:400:kworker.0 Request processed in 86us (6702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.535676:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856989.535690:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856989.535695:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436428032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.535716:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436428032:12345-0@lo:400:kworker.0 Request processed in 22us (3859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.535722:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856989.535744:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436427392 00000100:00100000:3.0:1787856989.535747:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436427392 00000100:00100000:3.0:1787856989.535768:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436427904 00000100:00100000:3.0:1787856989.535770:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436427904 00000100:00100000:3.0:1787856989.535796:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787856989.535801:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436427392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.535830:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436427392:12345-0@lo:400:kworker.0 Request processed in 29us (6634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.535835:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787856989.535844:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787856989.535849:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436427904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.535868:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436427904:12345-0@lo:400:kworker.0 Request processed in 20us (3754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.535873:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787856989.535892:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436427264 00000100:00100000:3.0:1787856989.535895:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436427264 00000100:00100000:3.0:1787856989.535927:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787856989.535933:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3626:x1874703436427264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.535957:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3626:x1874703436427264:12345-0@lo:400:kworker.0 Request processed in 25us (3909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.535963:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:3.0:1787856989.536017:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a7b480 x1874703436427776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856989.536032:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436427776:0@lo:400:kworker.0 00010000:00080000:3.0:1787856989.536044:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83f92c0 x1874703436428416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856989.536052:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436428416:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.536063:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436427520:0@lo:400:kworker.0 00010000:00080000:3.0:1787856989.536084:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d275b480 x1874703436428288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856989.536092:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d275b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436428288:0@lo:400:kworker.0 00010000:00080000:3.0:1787856989.536103:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83fb480 x1874703436428800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856989.536110:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436428800:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.536147:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3626:1874703436427264:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.536156:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436427904:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.536164:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436427392:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.536173:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436428032:0@lo:400:kworker.0 00010000:00080000:3.0:1787856989.536183:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83f9680 x1874703436428672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856989.536191:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436428672:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.536296:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787856989.536305:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436428544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.536343:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436428544:12345-0@lo:400:kworker.0 Request processed in 39us (4184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.536349:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787856989.536379:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83fbc00 x1874703436428544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856989.536388:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436428544:0@lo:400:kworker.0 00000100:00100000:3.0:1787856989.536440:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436427648:0@lo:8:kworker.0 00000100:00100000:3.0:1787856989.536470:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.536488:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d2759a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436428160:0@lo:8:kworker.0 00000100:00100000:3.0:1787856989.536505:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856989.536523:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436427648 00000100:00100000:3.0:1787856989.536526:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436427648 00000100:00100000:3.0:1787856989.536542:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436428160 00000100:00100000:3.0:1787856989.536544:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436428160 00000100:00100000:3.0:1787856989.536555:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856989.536560:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436427648:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787856989.536583:0:18682:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1787856989.536609:0:18682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc25410d92a3c4f8f 00002000:00100000:3.0:1787856989.536623:0:18682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff906601a48000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787856989.536626:0:18682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787856989.536629:0:18682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787856989.536794:0:18682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787856989.536815:0:18682:0:(import.c:65:import_set_state_nolock()) ffff906601a4b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856989.536846:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1874703436427648:12345-0@lo:8:kworker.0 Request processed in 285us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.536853:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856989.536864:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787856989.536868:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1874703436428160:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787856989.536880:0:18682:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1787856989.536893:0:18682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc25410d92a3c4f96 00002000:00100000:3.0:1787856989.536898:0:18682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9065f73a9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787856989.536907:0:18682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787856989.536909:0:18682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787856989.536928:0:18682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787856989.536938:0:18682:0:(import.c:65:import_set_state_nolock()) ffff9065f73ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856989.536961:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1874703436428160:12345-0@lo:8:kworker.0 Request processed in 93us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.536967:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787856989.536991:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a7b840 x1874703436427648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787857014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787856989.537002:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787856989.537009:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787856989.537013:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787856989.537016:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9066007b3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787856989.537028:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787856989.537031:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874703436427648:0@lo:8:kworker.0 00010000:00080000:3.0:1787856989.537040:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065d2759a40 x1874703436428160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787857014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787856989.537048:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787856989.537051:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787856989.537054:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787856989.537056:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9064c8172000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787856989.537130:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856989.537134:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856989.537136:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787856989.537171:0:17201:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1787856989.537186:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17201:1874703436429056:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787856989.537209:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856989.537239:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c78e4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856989.537251:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856989.537285:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856989.537318:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436428928 00000100:00100000:0.0:1787856989.537322:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436428928 00000100:00100000:0.0:1787856989.537349:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787856989.537356:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436428928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856989.537388:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787856989.537421:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436428928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856989.537427:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787856989.537440:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856989.537462:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2e1c0 x1874703436428928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856989.537474:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856989.537491:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436429056 00000100:00100000:0.0:1787856989.537494:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436429056 00000100:00100000:0.0:1787856989.537515:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787856989.537520:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1874703436429056:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787856989.537755:0:17918:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787856989.537777:0:17918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874703436429312:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787856989.537799:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856989.537814:0:17918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c78e4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787856989.537827:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436429184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856989.537850:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856989.537875:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436429184 00000100:00100000:0.0:1787856989.537878:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436429184 00000100:00100000:0.0:1787856989.537904:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787856989.537910:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1874703436429184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856989.537920:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787856989.537948:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1874703436429184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856989.537954:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787856989.537966:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787856989.537983:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2e1c0 x1874703436429184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856989.537995:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436429184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787856989.538012:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436429312 00000100:00100000:0.0:1787856989.538016:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436429312 00000100:00100000:0.0:1787856989.538034:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787856989.538039:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17918:x1874703436429312:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787856989.538096:0:17200:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787856989.538166:0:17200:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 523247948579ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787856989.538173:0:17200:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787856989.541045:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787856989.541064:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d2759a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874703436428160:0@lo:8:kworker.0 00000004:00080000:1.0:1787856989.544525:0:17917:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787856989.544639:0:17917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 523254421524ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787856989.544647:0:17917:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:3.0:1787856989.547887:0:18682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787856989.547901:0:18682:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787856989.547908:0:18682:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:2.0:1787856989.548187:0:17154:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787856989.549352:0:17906:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1787856989.549906:0:18680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787856989.549913:0:18680:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787856989.550012:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17918:x1874703436429312:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11967us (12207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856989.550023:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787856989.550088:0:17918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2e940 x1874703436429312/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787857005 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856989.550104:0:17918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874703436429312:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787856989.550120:0:17918:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787856989.550165:0:17918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874703436429440:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787856989.550205:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856989.550248:0:17918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856989.550268:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436429440 00000100:00100000:1.0:1787856989.550286:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436429440 00000100:00100000:1.0:1787856989.550334:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787856989.550343:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17918:x1874703436429440:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787856989.550369:0:18998:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787856989.550401:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17918:x1874703436429440:12345-0@lo:5:osp-pre-1-1.0 Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856989.550407:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787856989.550431:0:17918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83fa1c0 x1874703436429440/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787857005 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856989.550440:0:17918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874703436429440:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787856989.550449:0:17918:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787856989.550473:0:17918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874703436429568:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787856989.550494:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856989.550508:0:17918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065e9d223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856989.550526:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436429568 00000100:00100000:1.0:1787856989.550529:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436429568 00000100:00100000:1.0:1787856989.550551:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787856989.550558:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17918:x1874703436429568:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787856989.550583:0:18680:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1787856989.598803:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.598816:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.598843:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.598847:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.598855:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.598872:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.598884:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.598905:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.598932:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856989.599580:0:19512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856989.599589:0:19512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.599598:0:19512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856989.599602:0:19512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.599611:0:19512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.599631:0:19512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.599639:0:19512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4f9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.599661:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.599663:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.599664:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.603300:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.603312:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603329:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.603334:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.603341:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603362:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603372:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603380:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603399:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856989.603413:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856989.603419:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603426:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856989.603430:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603440:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603457:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603465:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c4fa4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.603489:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.603491:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.603493:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.607170:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.607183:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607201:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.607206:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.607213:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607714:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607723:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607732:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607756:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856989.607771:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856989.607776:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607800:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856989.607804:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607813:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607829:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607837:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.607854:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.607856:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.607857:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.611532:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.611547:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611565:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.611570:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.611577:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611591:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611619:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611628:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611647:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856989.611661:0:19512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856989.611668:0:19512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611676:0:19512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856989.611680:0:19512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611690:0:19512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611706:0:19512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611715:0:19512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.611734:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.611742:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.611744:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856989.614029:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.614040:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.614055:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.615412:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.615430:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.615447:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.615473:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.615481:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.615507:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856989.615938:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856989.615947:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.615955:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bba00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856989.615960:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.615969:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.615985:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.615992:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.616011:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.616013:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.616014:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.616881:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.616888:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.616901:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.616904:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.616917:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.616929:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.616937:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.616945:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.616968:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856989.617138:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.617146:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.617153:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.617157:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.617166:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.617181:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.617189:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c4fc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.617203:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.617211:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.617213:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856989.624861:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.624877:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.624897:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.624902:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.624908:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.624922:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.624933:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.624942:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.624962:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856989.625407:0:19512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856989.625416:0:19512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.625425:0:19512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbc00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856989.625430:0:19512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.625440:0:19512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.625458:0:19512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.625476:0:19512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adb7cea7/0xc25410d92a3c4fc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.625493:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.625495:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.625497:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856989.627946:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.627958:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.627975:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.627980:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.627987:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.628008:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.628019:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.628027:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.630565:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787856989.631533:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.631543:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.631560:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.631564:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.631570:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.631583:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.631592:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.631611:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635494:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787856989.635509:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635522:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856989.635615:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635642:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635666:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635673:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c07e2271/0xc25410d92a3c4fce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635698:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856989.635702:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635708:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bba00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856989.635716:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635723:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635731:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.635738:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.635739:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.635741:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.651282:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787856989.651297:0:18682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4fd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.656176:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787856989.656593:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787856989.656614:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787856989.656619:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1787856989.656719:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.656730:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656747:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.656751:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.656758:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656771:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656781:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656800:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656820:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856989.656832:0:19512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.656837:0:19512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656844:0:19512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb000 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.656849:0:19512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656858:0:19512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656875:0:19512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656883:0:19512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a6fa3ac/0xc25410d92a3c4fdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.656898:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.656900:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.656901:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856989.659809:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17918:x1874703436429568:12345-0@lo:5:osp-pre-1-1.0 Request processed in 109242us (109304us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787856989.659823:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787856989.661532:0:17918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787856989.661552:0:17918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fa1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17918:1874703436429568:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787856989.661567:0:17918:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787856989.661621:0:17918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17918:1874703436429696:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787856989.661669:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856989.661706:0:17918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c78ea540 going to sleep for 11 seconds 00002000:00010000:0.0:1787856989.661798:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.661805:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.661822:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.661826:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.661833:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.661847:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.661857:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.661865:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.661889:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856989.662310:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.662317:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.662331:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb400 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.662335:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.662344:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.662360:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.662367:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c46f8ba/0xc25410d92a3c4fe3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.662385:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.662387:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.662389:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856989.662479:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436429696 00000100:00100000:3.0:1787856989.662486:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436429696 00000100:00100000:3.0:1787856989.662532:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856989.662541:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17918:x1874703436429696:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787856989.662607:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17918:x1874703436429696:12345-0@lo:900:osp-pre-1-1.0 Request processed in 67us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.662614:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787856989.664982:0:17918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906601a2e940 x1874703436429696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787857005 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856989.665000:0:17918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17918:1874703436429696:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1787856989.665492:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.665502:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.665519:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.665524:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.665538:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.665554:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.665564:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.665573:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.665596:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856989.667494:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856989.667507:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.667521:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856989.667526:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.667538:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.667561:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.667576:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082738506/0xc25410d92a3c4fea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.667598:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.667600:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.667602:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856989.670429:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.670441:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.670461:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.670466:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.670472:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.670488:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.670499:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.670520:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.670553:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856989.670571:0:19512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856989.670581:0:19512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.670591:0:19512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bba00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856989.670596:0:19512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.670607:0:19512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.670625:0:19512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.670632:0:19512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb441601/0xc25410d92a3c4ff1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.670650:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.670652:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.670654:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787856989.672017:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787856989.672027:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.672053:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1787856989.672058:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856989.674576:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.674601:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.674614:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.674622:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.675051:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856989.678289:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.678302:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.678320:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.678325:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.678332:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.678346:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.678376:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.678384:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.682404:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856989.682418:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.682447:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007baa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.682452:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.682463:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.682486:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.682493:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eccc8759/0xc25410d92a3c4ff8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.683356:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.683364:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.683374:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.683377:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.683385:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.683398:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.683417:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.683419:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.683421:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.684618:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787856989.684630:0:18682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c4fff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.684984:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.686481:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.686494:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.686511:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.686516:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.686522:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.686535:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.686545:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.686564:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.686587:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856989.686857:0:19512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.686865:0:19512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.686874:0:19512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.686879:0:19512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.686890:0:19512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.686908:0:19512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.686916:0:19512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c5006 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.686936:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.686938:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.686940:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.688200:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.688209:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.689377:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.689383:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.689390:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.689407:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.689420:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.689428:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.689460:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856989.690467:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856989.690477:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.690488:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fee00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856989.690493:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.690502:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.690520:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.690527:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3cb418a/0xc25410d92a3c500d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.690549:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.690551:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.690552:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.691505:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.691515:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.691537:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.691541:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.691547:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.691560:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.691569:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.691577:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.691601:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856989.692013:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856989.692020:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.692029:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856989.692032:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.692055:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.692070:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.692078:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000790d81e4/0xc25410d92a3c5014 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.692094:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.692096:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.692098:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.693486:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.693498:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.693513:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.693518:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.693523:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.693536:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.693559:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.693566:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.693594:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787856989.694078:0:19512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856989.694086:0:19512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.694095:0:19512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fea00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:1.0:1787856989.694099:0:19512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.694107:0:19512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.694123:0:19512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.694142:0:19512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055cf7310/0xc25410d92a3c501b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856989.694162:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.694164:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856989.694166:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.694624:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.694630:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.694642:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.694646:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.694652:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.694662:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.694670:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.694677:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.695410:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856989.696353:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.696362:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.696376:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.696380:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.696384:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.696395:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.696403:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.696410:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696637:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856989.696647:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696669:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.696673:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696681:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696697:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696703:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d69f7b4/0xc25410d92a3c5022 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696720:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.696723:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696729:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffc00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.696731:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696738:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696748:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.696760:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.696761:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.696763:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.704024:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787856989.704040:0:18682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019eae3d6/0xc25410d92a3c5029 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856989.704633:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.704641:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704660:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.704665:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.704671:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704684:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704693:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704700:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704717:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856989.704727:0:19512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856989.704733:0:19512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704741:0:19512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:3.0:1787856989.704746:0:19512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704756:0:19512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704784:0:19512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704792:0:19512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ee9b244/0xc25410d92a3c5030 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.704806:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.704807:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856989.704809:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.705090:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.705096:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705104:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.705107:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.705111:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705120:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705128:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705135:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705156:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856989.705501:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.705508:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.705515:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff800 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.705519:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.705527:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.705540:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.705547:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c2a7d4e/0xc25410d92a3c5037 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.705564:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.705565:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.705567:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.705572:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.705649:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.705655:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705663:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.705666:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.705670:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705678:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705686:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705693:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.705713:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856989.705993:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.705999:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706008:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.706016:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.706021:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706030:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706038:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706046:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706057:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787856989.706547:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856989.706554:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706570:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffa00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.706574:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706582:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706597:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706605:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024da0b30/0xc25410d92a3c503e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706623:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.706626:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706633:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.706636:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706644:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706653:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706666:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010e9bf8f/0xc25410d92a3c5045 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.706680:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.706681:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.706683:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.706691:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856989.706827:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.706833:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706842:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.706845:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.706850:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706859:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706868:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706881:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.706901:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856989.707191:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787856989.707197:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.707205:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787856989.707209:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856989.707213:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.707241:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.707314:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.707323:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856989.707335:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1787856989.707365:0:18682:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1787856989.707459:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17201:x1874703436429056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 169933us (170243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856989.707477:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787856989.708408:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856989.708417:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708427:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274ac00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.708431:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708440:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708458:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708466:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c504c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708484:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856989.708488:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708503:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274b600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787856989.708507:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708514:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708525:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708532:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000589e42ad/0xc25410d92a3c5053 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856989.708544:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.708546:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856989.708548:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856989.708592:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17201:1874703436429056:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787856989.708606:0:17201:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1787856989.708657:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17201:1874703436429824:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787856989.708703:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856989.708746:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c78ea780 going to sleep for 11 seconds 00010000:00010000:0.0:1787856989.708759:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856989.709429:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436429824 00000100:00100000:3.0:1787856989.709437:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436429824 00000100:00100000:3.0:1787856989.709487:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787856989.709496:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17201:x1874703436429824:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787856989.709532:0:18998:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1787856989.721626:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17201:x1874703436429824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12124us (12916us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787856989.721639:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856989.724457:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17201:1874703436429824:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787856989.724479:0:17201:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1787856989.907096:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856990.939555:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856991.057634:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d2759a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436429952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787856991.057717:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856991.058003:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436429952 00000100:00100000:1.0:1787856991.058012:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436429952 00000100:00100000:1.0:1787856991.058079:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787856991.058091:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436429952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787856991.058122:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1787856991.060526:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856991.064998:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436429952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6899us (7269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856991.065014:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787856991.068644:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d2759a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436429952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856991.570736:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856991.570759:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436430080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787856991.570834:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856991.571019:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436430080 00000100:00100000:1.0:1787856991.571027:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436430080 00000100:00100000:1.0:1787856991.571079:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787856991.571088:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436430080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787856991.571119:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787856991.571162:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436430080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856991.571169:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787856991.571264:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436430080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787856991.571512:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436430208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856991.571545:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856991.571602:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436430208 00000100:00100000:1.0:1787856991.571606:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436430208 00000100:00100000:1.0:1787856991.571629:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787856991.571635:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d275b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436430208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856991.571654:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787856991.578729:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d275b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436430208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7084us (7174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856991.578745:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787856991.579042:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436430208:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787856991.954340:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787856992.043697:0:19852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1787856992.658142:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787856992.994951:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787856993.035985:0:19904:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787856993.036189:0:19904:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787856994.001598:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787856994.017072:0:19954:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787856994.017371:0:19954:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787856994.133099:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856994.136049:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436430336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856994.136138:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856994.136601:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436430336 00000100:00100000:0.0:1787856994.136610:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436430336 00000100:00100000:0.0:1787856994.136674:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787856994.136683:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d2759a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436430336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856994.136720:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787856994.136772:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d2759a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436430336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.136779:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787856994.142200:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856994.148434:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436430336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856994.329787:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.330053:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426900736 00000100:00100000:3.0:1787856994.330064:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426900736 00000100:00100000:3.0:1787856994.330113:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:3.0:1787856994.330120:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1874703426900736:12345-192.168.202.6@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787856994.330148:0:17166:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 90f35eb6-658b-49d5-8d30-9116022ee9f3@192.168.202.6@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1787856994.330177:0:17166:0:(genops.c:1385:class_connect()) connect: client 90f35eb6-658b-49d5-8d30-9116022ee9f3, cookie 0xc25410d92a3c505a 00000100:00080000:3.0:1787856994.330397:0:17166:0:(import.c:65:import_set_state_nolock()) ffff90660043d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856994.330481:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+5:2398:x1874703426900736:12345-192.168.202.6@tcp:250:mount.lustre.0 Request processed in 359us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.330503:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:3.0:1787856994.342160:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.345168:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426900864 00000100:00100000:0.0:1787856994.345182:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426900864 00000100:00100000:0.0:1787856994.345283:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:0.0:1787856994.345294:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+5:14905:x1874703426900864:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787856994.345311:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856994.345328:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bba00/0xc25410d92a3c5061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a62fa expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.345359:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bba00/0xc25410d92a3c5061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62fa expref: 6 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.345372:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bba00/0xc25410d92a3c5061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a62fa expref: 6 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.345399:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bba00, rc 0) 00000100:00100000:0.0:1787856994.345473:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+6:14905:x1874703426900864:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 181us (3324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.345480:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:1.0:1787856994.354988:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856994.355245:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426900992 00000100:00100000:2.0:1787856994.355255:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426900992 00000100:00100000:2.0:1787856994.355309:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:2.0:1787856994.355319:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+6:14905:x1874703426900992:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787856994.355455:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+6:14905:x1874703426900992:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 137us (475us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787856994.355463:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:2.0:1787856994.365536:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.365687:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426901120 00000100:00100000:3.0:1787856994.365698:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426901120 00000100:00100000:3.0:1787856994.365751:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:3.0:1787856994.365762:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+6:14905:x1874703426901120:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787856994.365779:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856994.365795:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274b800/0xc25410d92a3c5068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6301 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.365822:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274b800/0xc25410d92a3c5068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6301 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.365843:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274b800/0xc25410d92a3c5068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6301 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.365852:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274b800, rc 0) 00000100:00100000:3.0:1787856994.365915:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+7:14905:x1874703426901120:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 155us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.365922:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:3.0:1787856994.370343:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.371841:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426901248 00000100:00100000:0.0:1787856994.371854:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426901248 00000100:00100000:0.0:1787856994.371918:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:0.0:1787856994.371927:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+7:14905:x1874703426901248:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787856994.372088:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14905:x1874703426901248:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 162us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.372097:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:1.0:1787856994.374194:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856994.378583:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426901376 00000100:00100000:2.0:1787856994.378630:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426901376 00000100:00100000:2.0:1787856994.378724:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:2.0:1787856994.378737:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14905:x1874703426901376:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787856994.379700:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14905:x1874703426901376:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 957us (5509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.379713:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:2.0:1787856994.415307:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.415573:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426901504 00000100:00100000:0.0:1787856994.415587:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426901504 00000100:00100000:0.0:1787856994.415669:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:0.0:1787856994.415680:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14923:x1874703426901504:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787856994.415899:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14923:x1874703426901504:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 221us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.415908:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:3.0:1787856994.447197:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856994.449623:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426901632 00000100:00100000:2.0:1787856994.449644:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426901632 00000100:00100000:2.0:1787856994.449747:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:2.0:1787856994.449759:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14923:x1874703426901632:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856994.449995:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14923:x1874703426901632:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 236us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.450004:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:2.0:1787856994.465885:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856994.468302:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426901760 00000100:00100000:1.0:1787856994.468324:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426901760 00000100:00100000:1.0:1787856994.468427:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:1.0:1787856994.468440:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14923:x1874703426901760:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787856994.468673:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14923:x1874703426901760:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 234us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856994.468683:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:3.0:1787856994.481976:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.482092:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426901888 00000100:00100000:0.0:1787856994.482108:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426901888 00000100:00100000:0.0:1787856994.482189:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:0.0:1787856994.482201:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+8:14905:x1874703426901888:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787856994.482441:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856994.482567:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007bb600/0xc25410d92a3c506f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6332 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.482627:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007bb600/0xc25410d92a3c506f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6332 expref: 9 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.482642:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007bb600/0xc25410d92a3c506f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6332 expref: 9 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.482653:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb600, rc 0) 00000100:00100000:0.0:1787856994.482773:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+9:14905:x1874703426901888:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 573us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.482782:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:2.0:1787856994.486910:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.487005:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426902016 00000100:00100000:3.0:1787856994.487018:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426902016 00000100:00100000:3.0:1787856994.487129:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:3.0:1787856994.487140:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e85ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+9:14905:x1874703426902016:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787856994.487188:0:17168:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787856994.487264:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787856994.487269:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787856994.487273:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787856994.487276:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787856994.487279:0:17168:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787856994.490291:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e85ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+9:14905:x1874703426902016:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 3134us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.490312:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:2.0:1787856994.494000:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.494111:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426902144 00000100:00100000:0.0:1787856994.494123:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426902144 00000100:00100000:0.0:1787856994.494398:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:0.0:1787856994.494411:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+9:14905:x1874703426902144:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787856994.494433:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856994.494553:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6339 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.494594:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 10 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.494609:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 10 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856994.494620:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007ba000, rc 0) 00000100:00100000:0.0:1787856994.494736:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14905:x1874703426902144:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 327us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.494776:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:2.0:1787856994.497711:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.497969:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426902272 00000100:00100000:3.0:1787856994.497982:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426902272 00000100:00100000:3.0:1787856994.498103:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:3.0:1787856994.498115:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14905:x1874703426902272:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787856994.498396:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14905:x1874703426902272:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 281us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.498406:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:2.0:1787856994.506039:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.506162:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426902400 00000100:00100000:0.0:1787856994.506177:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426902400 00000100:00100000:0.0:1787856994.506535:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:0.0:1787856994.507352:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14905:x1874703426902400:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787856994.507686:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14905:x1874703426902400:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 352us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.507695:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:2.0:1787856994.512506:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.513395:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426902528 00000100:00100000:3.0:1787856994.513411:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426902528 00000100:00100000:2.0:1787856994.513959:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:2.0:1787856994.513975:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14928:x1874703426902528:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856994.514405:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14928:x1874703426902528:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 433us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.514414:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:2.0:1787856994.527610:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.527979:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426902656 00000100:00100000:0.0:1787856994.527993:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426902656 00000100:00100000:0.0:1787856994.528075:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:0.0:1787856994.528087:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14928:x1874703426902656:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787856994.528340:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:14928:x1874703426902656:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 255us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.528349:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:1.0:1787856994.538040:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856994.538160:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.538539:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426902784 00000100:00100000:0.0:1787856994.538553:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426902784 00000100:00100000:0.0:1787856994.538608:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426903040 00000100:00100000:0.0:1787856994.538611:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426903040 00000100:00100000:0.0:1787856994.538629:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1787856994.538639:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1874703426902784:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787856994.538681:0:17176:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 54732495-c2d9-4110-96c9-7cc6d03017e0@192.168.202.6@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1787856994.538756:0:17176:0:(genops.c:1385:class_connect()) connect: client 54732495-c2d9-4110-96c9-7cc6d03017e0, cookie 0xc25410d92a3c507d 00000004:00100000:0.0:1787856994.538790:0:17176:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1787856994.539052:0:17176:0:(import.c:65:import_set_state_nolock()) ffff9064c68e0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856994.539272:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2398:x1874703426902784:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 632us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.539281:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1787856994.539307:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:0.0:1787856994.539312:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1874703426903040:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787856994.539334:0:17176:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from 54732495-c2d9-4110-96c9-7cc6d03017e0@192.168.202.6@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1787856994.539388:0:17176:0:(genops.c:1385:class_connect()) connect: client 54732495-c2d9-4110-96c9-7cc6d03017e0, cookie 0xc25410d92a3c5084 00000004:00100000:0.0:1787856994.539406:0:17176:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1787856994.539831:0:17176:0:(import.c:65:import_set_state_nolock()) ffff9064c68e1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856994.539872:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2398:x1874703426903040:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 558us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.539880:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:2.0:1787856994.547547:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856994.547606:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.547756:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426903168 00000100:00100000:0.0:1787856994.547770:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426903168 00000100:00100000:0.0:1787856994.547860:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426902912 00000100:00100000:0.0:1787856994.547865:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426902912 00000100:00100000:0.0:1787856994.547888:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1787856994.547898:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:0:x1874703426903168:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787856994.547952:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787856994.548067:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:0:x1874703426903168:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 170us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.548075:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1787856994.548097:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1787856994.548104:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:0:x1874703426902912:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787856994.548125:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787856994.548186:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:0:x1874703426902912:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 82us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.548194:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00080000:2.0:1787856994.549035:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787856994.549042:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787856994.549794:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.549888:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426903296 00000100:00100000:0.0:1787856994.549897:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426903296 00000100:00100000:0.0:1787856994.549957:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1787856994.549967:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14905:x1874703426903296:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787856994.550001:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787856994.550112:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14905:x1874703426903296:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 146us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.550121:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1787856994.553727:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.553883:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426903424 00000100:00100000:3.0:1787856994.557276:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426903424 00000100:00100000:3.0:1787856994.557402:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1787856994.557416:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14905:x1874703426903424:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787856994.557685:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14905:x1874703426903424:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 272us (3972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.557694:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1787856994.560364:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.560402:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856994.560438:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.560950:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426903808 00000100:00100000:3.0:1787856994.560984:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426903808 00000100:00100000:3.0:1787856994.561057:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:3.0:1787856994.561069:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14905:x1874703426903808:12345-192.168.202.6@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787856994.561178:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14905:x1874703426903808:12345-192.168.202.6@tcp:900:mount.lustre.0 Request processed in 111us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.561186:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1787856994.563238:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426903552 00000100:00100000:1.0:1787856994.563254:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426903552 00000100:00100000:1.0:1787856994.563317:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426903680 00000100:00100000:1.0:1787856994.563342:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426903680 00000100:00100000:1.0:1787856994.563372:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1787856994.563381:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874703426903552:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787856994.563424:0:18680:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 54732495-c2d9-4110-96c9-7cc6d03017e0@192.168.202.6@tcp t0 exp 0000000000000000 cur 528 last 0 00000100:00100000:2.0:1787856994.563651:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1787856994.563658:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874703426903680:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787856994.563679:0:18683:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 54732495-c2d9-4110-96c9-7cc6d03017e0@192.168.202.6@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1787856994.563712:0:18683:0:(genops.c:1385:class_connect()) connect: client 54732495-c2d9-4110-96c9-7cc6d03017e0, cookie 0xc25410d92a3c5092 00002000:00100000:2.0:1787856994.563728:0:18683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 54732495-c2d9-4110-96c9-7cc6d03017e0/ffff9064c78b5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787856994.563753:0:18683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787856994.563978:0:18683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787856994.564022:0:18683:0:(import.c:65:import_set_state_nolock()) ffff9064c78b3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856994.564111:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2398:x1874703426903680:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 450us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.564118:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000020:00000080:1.0:1787856994.564638:0:18680:0:(genops.c:1385:class_connect()) connect: client 54732495-c2d9-4110-96c9-7cc6d03017e0, cookie 0xc25410d92a3c508b 00002000:00100000:1.0:1787856994.564648:0:18680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 54732495-c2d9-4110-96c9-7cc6d03017e0/ffff9064c79b1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787856994.564659:0:18680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787856994.564828:0:18680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787856994.564852:0:18680:0:(import.c:65:import_set_state_nolock()) ffff9064c79b4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787856994.564898:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2398:x1874703426903552:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 1517us (4548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856994.564906:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1787856994.565434:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.565815:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426903936 00000100:00100000:3.0:1787856994.565826:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426903936 00000100:00100000:3.0:1787856994.565877:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1787856994.565888:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14905:x1874703426903936:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787856994.567375:0:17177:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1391us 00000004:00200000:3.0:1787856994.607015:0:17177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787856994.607902:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14905:x1874703426903936:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 42004us (42458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.607922:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1787856994.641636:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436430464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856994.641749:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856994.642036:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436430464 00000100:00100000:0.0:1787856994.642046:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436430464 00000100:00100000:0.0:1787856994.642143:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856994.642158:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436430464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787856994.642187:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787856994.642294:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436430464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.642302:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787856994.642444:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856994.642502:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436430464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787856994.644992:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436430592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856994.645086:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856994.645368:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436430592 00000100:00100000:2.0:1787856994.645378:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436430592 00000100:00100000:2.0:1787856994.645468:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787856994.645478:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436430592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787856994.645509:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787856994.645564:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874703436430592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.645589:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787856994.648093:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856994.648185:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436430592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856994.652336:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436430720:0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.652448:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856994.652498:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436431232:0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.652527:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856994.652547:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436431744:0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.652594:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856994.652626:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787856994.652632:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436431104:0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.652656:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856994.652674:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436431616:0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.652695:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856994.652739:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436431232 00000100:00100000:3.0:1787856994.652748:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436431232 00000100:00100000:3.0:1787856994.652814:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787856994.652825:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436431232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.652887:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436431232:12345-0@lo:400:kworker.0 Request processed in 63us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.652895:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787856994.654469:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436431744 00000100:00100000:3.0:1787856994.654480:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436431744 00000100:00100000:3.0:1787856994.654540:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436431104 00000100:00100000:3.0:1787856994.654545:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436431104 00000100:00100000:3.0:1787856994.654557:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436431616 00000100:00100000:3.0:1787856994.654560:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436431616 00000100:00100000:3.0:1787856994.654582:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856994.654593:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436431744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.654686:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874703436431744:12345-0@lo:400:kworker.0 Request processed in 94us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.654694:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787856994.654708:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856994.654716:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436431104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.654747:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874703436431104:12345-0@lo:400:kworker.0 Request processed in 33us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.654771:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787856994.654784:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787856994.654790:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436431616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.654821:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436431616:12345-0@lo:400:kworker.0 Request processed in 31us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.654827:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787856994.654873:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856994.654878:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787856994.654899:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436430976:0@lo:400:kworker.0 00000100:00100000:1.0:1787856994.655048:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436430848:0@lo:400:kworker.0 00000100:00100000:1.0:1787856994.660586:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856994.660648:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436431360:0@lo:400:kworker.0 00000100:00100000:1.0:1787856994.660686:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856994.660706:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436431872:0@lo:400:kworker.0 00000100:00100000:1.0:1787856994.660732:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856994.660794:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436430848 00000100:00100000:1.0:1787856994.660802:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436430848 00000100:00100000:1.0:1787856994.660856:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787856994.660865:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436430848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856994.660921:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436430848:12345-0@lo:400:kworker.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856994.660928:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787856994.661376:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856994.661419:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436431488:0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.661449:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856994.661476:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436431872 00000100:00100000:3.0:1787856994.661480:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436431872 00000100:00100000:3.0:1787856994.661528:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436431488 00000100:00100000:3.0:1787856994.661531:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436431488 00000100:00100000:3.0:1787856994.661547:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787856994.661554:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436431872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.661590:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436431872:12345-0@lo:400:kworker.0 Request processed in 36us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.661596:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787856994.661613:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787856994.661619:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436431488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.661673:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874703436431488:12345-0@lo:400:kworker.0 Request processed in 54us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.661680:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787856994.661706:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787856994.661740:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d68780 x1874703436431488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856994.661847:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436431360 00000100:00100000:2.0:1787856994.661852:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436431360 00000100:00100000:2.0:1787856994.661894:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436430976 00000100:00100000:2.0:1787856994.661897:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436430976 00000100:00100000:2.0:1787856994.661914:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856994.661921:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436431360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856994.661969:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436431360:12345-0@lo:400:kworker.0 Request processed in 49us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.661976:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856994.661987:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787856994.661993:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436430976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856994.662018:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436430976:12345-0@lo:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.662023:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856994.662174:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874703436431488:0@lo:400:kworker.0 00000100:00080000:3.0:1787856994.662184:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856994.662197:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436432000:0@lo:400:kworker.0 00000100:00100000:3.0:1787856994.662266:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856994.662317:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436430976:0@lo:400:kworker.0 00000100:00100000:2.0:1787856994.662446:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436432000 00000100:00100000:2.0:1787856994.662450:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436432000 00000100:00100000:2.0:1787856994.662490:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787856994.662497:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436432000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856994.662533:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874703436432000:12345-0@lo:400:kworker.0 Request processed in 36us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856994.662539:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787856994.662662:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436430848:0@lo:400:kworker.0 00000100:00100000:1.0:1787856994.662675:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436431360:0@lo:400:kworker.0 00010000:00080000:1.0:1787856994.662688:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d6b480 x1874703436431872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856994.662699:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436431872:0@lo:400:kworker.0 00000100:00080000:3.0:1787856994.662888:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787856994.662912:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d69680 x1874703436432000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856994.662921:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874703436432000:0@lo:400:kworker.0 00010000:00080000:0.0:1787856994.664674:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d68000 x1874703436431104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856994.664720:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874703436431104:0@lo:400:kworker.0 00010000:00080000:0.0:1787856994.664740:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d692c0 x1874703436431616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856994.664749:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436431616:0@lo:400:kworker.0 00000100:00100000:0.0:1787856994.664777:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436431232:0@lo:400:kworker.0 00010000:00080000:0.0:1787856994.664790:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c5d68b40 x1874703436431744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856994.664799:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874703436431744:0@lo:400:kworker.0 00000100:00100000:0.0:1787856994.664861:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436430720 00000100:00100000:0.0:1787856994.664869:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436430720 00000100:00100000:0.0:1787856994.664947:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787856994.664958:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3624:x1874703436430720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856994.665066:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3624:x1874703436430720:12345-0@lo:400:kworker.0 Request processed in 110us (12624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856994.665074:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787856994.665277:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436430720:0@lo:400:kworker.0 00000100:00100000:2.0:1787856994.797735:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856994.797841:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426904064 00000100:00100000:3.0:1787856994.797854:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426904064 00000100:00100000:3.0:1787856994.797923:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1787856994.797934:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:14951:x1874703426904064:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:3.0:1787856994.797962:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856994.797997:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a200/0xc25410d92a3c5099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a636a expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.798087:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c50a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.798103:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c50a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.798120:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c50a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856994.798212:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787856994.798272:0:17172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787856994.798316:0:17172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c50a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.798345:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a200/0xc25410d92a3c5099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a636a expref: 8 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.798365:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c50a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a636a expref: 7 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856994.798375:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:3.0:1787856994.798378:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787856994.798382:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274b400, rc 0) 00000100:00100000:3.0:1787856994.798445:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+7:14951:x1874703426904064:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 513us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856994.798452:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00010000:00010000:0.0:1787856995.030996:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787856995.167628:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54732495-c2d9-4110-96c9-7cc6d03017e0 00000001:00080000:3.0:1787856995.167653:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1787856996.049601:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856996.177782:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856996.177815:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436432128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787856996.177912:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856996.178028:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436432128 00000100:00100000:0.0:1787856996.178038:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436432128 00000100:00100000:0.0:1787856996.178132:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856996.178144:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436432128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787856996.178184:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787856996.178279:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436432128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856996.178307:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787856996.178364:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436432128:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787856996.178527:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787856996.497960:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787856996.689563:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787856996.689597:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436432256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856996.689724:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856996.692789:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436432256 00000100:00100000:3.0:1787856996.692811:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436432256 00000100:00100000:3.0:1787856996.692907:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787856996.692919:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436432256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787856996.692970:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787856996.693107:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436432256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 186us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856996.693136:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787856996.693680:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436432384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787856996.693734:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856996.693841:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436432384 00000100:00100000:1.0:1787856996.693848:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436432384 00000100:00100000:1.0:1787856996.693890:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787856996.693899:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436432384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787856996.693924:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787856996.693974:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436432384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856996.693981:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787856996.694026:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436432256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787856996.694108:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436432384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787856996.821854:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856996.822006:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426904192 00000100:00100000:3.0:1787856996.822020:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426904192 00000100:00080000:0.0:1787856996.822061:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856996.822105:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1787856996.822128:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+7:15003:x1874703426904192:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:3.0:1787856996.822185:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787856996.822345:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+7:15003:x1874703426904192:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 231us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856996.822355:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1787856996.827992:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856996.828344:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426904320 00000100:00100000:1.0:1787856996.828358:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426904320 00000100:00080000:0.0:1787856996.828517:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856996.828572:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1787856996.828587:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+6:15003:x1874703426904320:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1787856996.828632:0:17175:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787856996.828764:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+6:15003:x1874703426904320:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 181us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856996.828795:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:0.0:1787856996.838109:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856996.838293:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426904448 00000100:00100000:2.0:1787856996.838307:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426904448 00000100:00100000:2.0:1787856996.838402:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1787856996.838414:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54732495-c2d9-4110-96c9-7cc6d03017e0+6:15003:x1874703426904448:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:2.0:1787856996.838448:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787856996.838565:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54732495-c2d9-4110-96c9-7cc6d03017e0+6:15003:x1874703426904448:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 153us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856996.838574:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00080000:0.0:1787856996.838725:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856996.846039:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856996.846169:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426904576 00000100:00100000:0.0:1787856996.846183:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426904576 00000100:00100000:0.0:1787856996.846322:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1787856996.846335:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54732495-c2d9-4110-96c9-7cc6d03017e0+5:15003:x1874703426904576:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1787856996.846382:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1787856996.846568:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856996.846786:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54732495-c2d9-4110-96c9-7cc6d03017e0+5:15003:x1874703426904576:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 453us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856996.846795:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1787856997.030286:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856997.031042:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426904704 00000100:00100000:1.0:1787856997.031058:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426904704 00000100:00100000:1.0:1787856997.031133:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:1.0:1787856997.031153:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+10:15034:x1874703426904704:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787856997.031174:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856997.031213:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601939400/0xc25410d92a3c50a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6371 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856997.031277:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601939400/0xc25410d92a3c50a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6371 expref: 11 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856997.031291:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601939400/0xc25410d92a3c50a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6371 expref: 11 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856997.031303:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939400, rc 0) 00000100:00100000:1.0:1787856997.031380:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15034:x1874703426904704:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 238us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.031388:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:2.0:1787856997.041158:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856997.041385:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426904832 00000100:00100000:3.0:1787856997.041398:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426904832 00000100:00100000:3.0:1787856997.041471:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:3.0:1787856997.041482:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15034:x1874703426904832:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787856997.045101:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15034:x1874703426904832:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 3601us (3952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856997.045124:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:2.0:1787856997.052607:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856997.052798:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426904960 00000100:00100000:0.0:1787856997.052811:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426904960 00000100:00100000:0.0:1787856997.052891:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:0.0:1787856997.052903:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15034:x1874703426904960:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787856997.053555:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15034:x1874703426904960:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 650us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856997.053568:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:0.0:1787856997.067403:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856997.067669:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426905088 00000100:00100000:3.0:1787856997.067682:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426905088 00000100:00100000:3.0:1787856997.067758:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:3.0:1787856997.067770:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15041:x1874703426905088:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787856997.067986:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15041:x1874703426905088:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 218us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856997.068004:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 137 00010000:00010000:0.0:1787856997.073945:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856997.116668:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856997.116789:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426905216 00000100:00100000:0.0:1787856997.116803:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426905216 00000100:00100000:0.0:1787856997.116883:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:0.0:1787856997.116895:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15041:x1874703426905216:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787856997.117139:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15041:x1874703426905216:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 246us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856997.117148:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:2.0:1787856997.127642:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856997.127886:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426905344 00000100:00100000:1.0:1787856997.127902:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426905344 00000100:00100000:1.0:1787856997.127988:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00100000:1.0:1787856997.128000:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15041:x1874703426905344:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787856997.128454:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15041:x1874703426905344:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 454us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.128464:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00100000:1.0:1787856997.137557:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856997.142391:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426905472 00000100:00100000:3.0:1787856997.142412:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426905472 00000100:00100000:3.0:1787856997.142585:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00100000:3.0:1787856997.142599:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:15034:x1874703426905472:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787856997.142623:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856997.142647:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274a200/0xc25410d92a3c50ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a63a2 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856997.142686:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274a200/0xc25410d92a3c50ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a2 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856997.142700:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274a200/0xc25410d92a3c50ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a2 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856997.142712:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274a200, rc 0) 00000100:00100000:3.0:1787856997.142813:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:15034:x1874703426905472:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 216us (5271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856997.142822:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00100000:2.0:1787856997.155286:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856997.159394:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426905600 00000100:00100000:0.0:1787856997.159419:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426905600 00000100:00100000:0.0:1787856997.159712:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:0.0:1787856997.159728:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:15034:x1874703426905600:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787856997.159767:0:17168:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787856997.159800:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787856997.159805:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787856997.159808:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787856997.159812:0:17168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787856997.159814:0:17168:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787856997.163032:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:15034:x1874703426905600:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 3292us (7743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856997.164555:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:2.0:1787856997.166985:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856997.167138:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426905728 00000100:00100000:3.0:1787856997.167151:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426905728 00000100:00100000:3.0:1787856997.167273:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:3.0:1787856997.167285:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:15034:x1874703426905728:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787856997.167308:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856997.167331:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a63a9 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856997.167396:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 13 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856997.167412:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 13 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856997.167433:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274be00, rc 0) 00000100:00100000:3.0:1787856997.167499:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15034:x1874703426905728:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 217us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856997.167507:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:2.0:1787856997.170215:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856997.170359:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426905856 00000100:00100000:0.0:1787856997.170373:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426905856 00000100:00100000:0.0:1787856997.170534:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 143 00000100:00100000:0.0:1787856997.170546:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15034:x1874703426905856:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787856997.170746:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15034:x1874703426905856:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 202us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856997.170755:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 143 00000100:00100000:2.0:1787856997.173595:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856997.173701:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426905984 00000100:00100000:1.0:1787856997.173713:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426905984 00000100:00100000:1.0:1787856997.173782:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 144 00000100:00100000:1.0:1787856997.173793:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15034:x1874703426905984:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787856997.173998:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15034:x1874703426905984:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 206us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.174007:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 144 00000100:00100000:2.0:1787856997.178146:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856997.178342:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426906112 00000100:00100000:0.0:1787856997.178356:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426906112 00000100:00100000:0.0:1787856997.178438:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:0.0:1787856997.178450:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15045:x1874703426906112:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787856997.178656:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15045:x1874703426906112:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 207us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856997.178665:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:2.0:1787856997.182341:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856997.182460:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426906240 00000100:00100000:1.0:1787856997.182475:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426906240 00000100:00100000:1.0:1787856997.182542:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:1.0:1787856997.182553:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15045:x1874703426906240:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787856997.182771:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:15045:x1874703426906240:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 218us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.182779:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:2.0:1787856997.198097:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856997.198266:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787856997.198410:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426906368 00000100:00100000:3.0:1787856997.198430:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426906368 00000100:00100000:3.0:1787856997.198480:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426906624 00000100:00100000:3.0:1787856997.198483:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426906624 00000100:00100000:3.0:1787856997.198498:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:3.0:1787856997.198508:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874703426906368:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787856997.198548:0:17172:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from a956236f-01aa-4d39-8628-24f029cf1eae@192.168.202.6@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1787856997.198598:0:17172:0:(genops.c:1385:class_connect()) connect: client a956236f-01aa-4d39-8628-24f029cf1eae, cookie 0xc25410d92a3c50bc 00000004:00100000:3.0:1787856997.198631:0:17172:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1787856997.198754:0:17172:0:(import.c:65:import_set_state_nolock()) ffff9065fd267000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856997.199168:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+6:2398:x1874703426906368:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 658us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856997.199184:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:3.0:1787856997.199214:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1787856997.200956:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874703426906624:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787856997.201430:0:17172:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from a956236f-01aa-4d39-8628-24f029cf1eae@192.168.202.6@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1787856997.201491:0:17172:0:(genops.c:1385:class_connect()) connect: client a956236f-01aa-4d39-8628-24f029cf1eae, cookie 0xc25410d92a3c50c3 00000004:00100000:1.0:1787856997.201529:0:17172:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1787856997.201671:0:17172:0:(import.c:65:import_set_state_nolock()) ffff9064c88ca800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787856997.201782:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+6:2398:x1874703426906624:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 834us (3514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.208677:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:2.0:1787856997.217532:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856997.217598:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856997.217739:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426906880 00000100:00100000:1.0:1787856997.217762:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426906880 00000100:00100000:1.0:1787856997.217861:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426906496 00000100:00100000:1.0:1787856997.217865:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426906496 00000100:00100000:1.0:1787856997.217909:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1787856997.217921:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+7:15034:x1874703426906880:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787856997.217967:0:17175:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787856997.218066:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+7:15034:x1874703426906880:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 147us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.218074:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1787856997.218093:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:1.0:1787856997.218099:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:0:x1874703426906496:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787856997.218110:0:17175:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787856997.218133:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:0:x1874703426906496:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 34us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.218139:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00080000:3.0:1787856997.218771:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856997.219827:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856997.220026:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426906752 00000100:00100000:1.0:1787856997.220045:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426906752 00000100:00100000:1.0:1787856997.220118:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:1.0:1787856997.220128:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:0:x1874703426906752:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787856997.220163:0:17175:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1787856997.220321:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787856997.220457:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:0:x1874703426906752:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 329us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.220466:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1787856997.222462:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856997.222599:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426907008 00000100:00100000:0.0:1787856997.222609:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426907008 00000100:00100000:0.0:1787856997.222671:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1787856997.222681:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956236f-01aa-4d39-8628-24f029cf1eae+6:15034:x1874703426907008:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787856997.222784:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956236f-01aa-4d39-8628-24f029cf1eae+6:15034:x1874703426907008:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 103us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856997.222791:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1787856997.229299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856997.229383:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787856997.229477:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856997.229682:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426907136 00000100:00100000:1.0:1787856997.229695:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426907136 00000100:00100000:1.0:1787856997.229747:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426907264 00000100:00100000:1.0:1787856997.229762:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426907264 00000100:00100000:1.0:1787856997.229789:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1787856997.229809:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874703426907136:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787856997.229880:0:18998:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from a956236f-01aa-4d39-8628-24f029cf1eae@192.168.202.6@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1787856997.229928:0:18998:0:(genops.c:1385:class_connect()) connect: client a956236f-01aa-4d39-8628-24f029cf1eae, cookie 0xc25410d92a3c50ca 00002000:00100000:1.0:1787856997.229944:0:18998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a956236f-01aa-4d39-8628-24f029cf1eae/ffff9065df828800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787856997.229960:0:18998:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787856997.230086:0:18998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787856997.230127:0:18998:0:(import.c:65:import_set_state_nolock()) ffff9065df82e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787856997.230255:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956236f-01aa-4d39-8628-24f029cf1eae+6:2398:x1874703426907136:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 455us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.230263:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1787856997.230286:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:1.0:1787856997.230290:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874703426907264:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787856997.230325:0:18998:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from a956236f-01aa-4d39-8628-24f029cf1eae@192.168.202.6@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1787856997.230346:0:18998:0:(genops.c:1385:class_connect()) connect: client a956236f-01aa-4d39-8628-24f029cf1eae, cookie 0xc25410d92a3c50d1 00002000:00100000:1.0:1787856997.230351:0:18998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a956236f-01aa-4d39-8628-24f029cf1eae/ffff9065df82c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787856997.230357:0:18998:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787856997.230414:0:18998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787856997.230430:0:18998:0:(import.c:65:import_set_state_nolock()) ffff9065df82a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787856997.230466:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956236f-01aa-4d39-8628-24f029cf1eae+6:2398:x1874703426907264:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 173us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.230473:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:3.0:1787856997.235508:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426907392 00000100:00100000:3.0:1787856997.235530:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426907392 00000100:00100000:3.0:1787856997.235627:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:3.0:1787856997.235639:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a956236f-01aa-4d39-8628-24f029cf1eae+6:15034:x1874703426907392:12345-192.168.202.6@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787856997.235901:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a956236f-01aa-4d39-8628-24f029cf1eae+6:15034:x1874703426907392:12345-192.168.202.6@tcp:900:mount.lustre.0 Request processed in 262us (6616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856997.235910:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1787856997.245619:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787856997.246431:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426907520 00000100:00100000:1.0:1787856997.246446:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426907520 00000100:00100000:1.0:1787856997.246581:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1787856997.246596:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:15034:x1874703426907520:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787856997.246748:0:17178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787856997.246896:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:15034:x1874703426907520:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 303us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856997.246905:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1787856997.483399:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787856997.483519:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426907648 00000100:00100000:2.0:1787856997.483533:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426907648 00000100:00100000:2.0:1787856997.483625:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1787856997.483638:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+6:15069:x1874703426907648:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:2.0:1787856997.483666:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856997.483697:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c50d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a63da expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856997.483805:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856997.483825:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856997.483842:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856997.483898:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787856997.483903:0:17172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787856997.483927:0:17172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856997.483957:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ae00/0xc25410d92a3c50d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 8 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856997.483975:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 7 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856997.483982:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:2.0:1787856997.484000:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856997.484004:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ba00, rc 0) 00000100:00100000:2.0:1787856997.484090:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+7:15069:x1874703426907648:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 454us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856997.484097:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00010000:00010000:0.0:1787856998.100995:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856999.129001:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856999.250504:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436432512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856999.250606:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856999.250766:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436432512 00000100:00100000:1.0:1787856999.250777:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436432512 00000100:00100000:1.0:1787856999.250862:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787856999.250874:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436432512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856999.250913:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787856999.250974:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436432512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856999.250982:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787856999.251104:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856999.251158:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436432512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856999.761648:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436432768:0@lo:400:kworker.0 00000100:00100000:1.0:1787856999.761767:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856999.761849:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856999.761857:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436432640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856999.761890:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856999.762422:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436432640 00000100:00100000:1.0:1787856999.762431:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436432640 00000100:00100000:1.0:1787856999.762501:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787856999.762515:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436432640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787856999.762554:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787856999.762614:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436432640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856999.762641:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787856999.762702:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436432640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787856999.762767:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436432768 00000100:00100000:1.0:1787856999.762771:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436432768 00000100:00100000:1.0:1787856999.762802:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787856999.762810:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3624:x1874703436432768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856999.762850:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3624:x1874703436432768:12345-0@lo:400:kworker.0 Request processed in 40us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856999.762856:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787856999.762889:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436432896:0@lo:400:kworker.0 00000100:00100000:1.0:1787856999.763050:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856999.763078:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856999.763085:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436433024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856999.763116:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856999.763148:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436432896 00000100:00100000:1.0:1787856999.763152:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436432896 00000100:00100000:1.0:1787856999.763196:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856999.763203:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436432896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856999.763265:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436432896:12345-0@lo:400:kworker.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856999.763272:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856999.763302:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436432896:0@lo:400:kworker.0 00000100:00100000:1.0:1787856999.763326:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436432768:0@lo:400:kworker.0 00000100:00100000:1.0:1787856999.763676:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436433024 00000100:00100000:1.0:1787856999.763690:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436433024 00000100:00100000:1.0:1787856999.763718:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787856999.763725:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436433024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856999.763738:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787856999.763770:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436433024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856999.763777:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787856999.763805:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787856999.763821:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436433024:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787856999.763876:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856999.772915:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436433536:0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.773009:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856999.773048:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436434048:0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.773071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856999.773097:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787856999.773102:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436433408:0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.773125:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856999.773145:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436433920:0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.773205:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856999.773263:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436433536 00000100:00100000:3.0:1787856999.773271:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436433536 00000100:00100000:3.0:1787856999.773347:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856999.773377:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436433536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.773452:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436433536:12345-0@lo:400:kworker.0 Request processed in 77us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856999.773461:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856999.773488:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436434048 00000100:00100000:3.0:1787856999.773492:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436434048 00000100:00100000:3.0:1787856999.773517:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436433920 00000100:00100000:3.0:1787856999.773520:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436433920 00000100:00100000:3.0:1787856999.773537:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787856999.773543:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436434048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.773998:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436434048:12345-0@lo:400:kworker.0 Request processed in 453us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856999.774006:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787856999.774022:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787856999.774030:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436433920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.774065:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874703436433920:12345-0@lo:400:kworker.0 Request processed in 36us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856999.774071:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787856999.774097:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436433408 00000100:00100000:3.0:1787856999.774102:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436433408 00000100:00100000:3.0:1787856999.774131:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787856999.774138:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436433408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.774290:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436433152:0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.774336:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856999.774369:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436433664:0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.774402:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856999.774421:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436434176:0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.774446:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856999.774467:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436433152 00000100:00100000:1.0:1787856999.774474:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436433152 00000100:00100000:0.0:1787856999.774486:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787856999.774496:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436433280:0@lo:400:kworker.0 00000100:00100000:1.0:1787856999.774518:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856999.774527:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856999.774531:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436433152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.774545:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436433792:0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.779371:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856999.779486:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436433408:12345-0@lo:400:kworker.0 Request processed in 5344us (6355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856999.779504:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787856999.779575:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436433664 00000100:00100000:3.0:1787856999.779587:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436433664 00000100:00100000:3.0:1787856999.779644:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436434176 00000100:00100000:3.0:1787856999.779648:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436434176 00000100:00100000:3.0:1787856999.779671:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436433280 00000100:00100000:3.0:1787856999.779675:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436433280 00000100:00100000:3.0:1787856999.779686:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436433792 00000100:00100000:3.0:1787856999.779689:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436433792 00000100:00100000:3.0:1787856999.779707:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787856999.779716:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436433664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.779796:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436433664:12345-0@lo:400:kworker.0 Request processed in 82us (5393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856999.779803:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787856999.779815:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787856999.779822:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.779852:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436434176:12345-0@lo:400:kworker.0 Request processed in 31us (5405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856999.779858:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787856999.779869:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787856999.779875:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436433280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.779904:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436433280:12345-0@lo:400:kworker.0 Request processed in 30us (5379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856999.779910:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787856999.779922:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787856999.779928:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436433792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.779956:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874703436433792:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856999.779961:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787856999.779991:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787856999.780002:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787856999.780006:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856999.780036:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7abad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436433152:12345-0@lo:400:kworker.0 Request processed in 5507us (5696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856999.780049:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787856999.780056:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436433408:0@lo:400:kworker.0 00010000:00080000:3.0:1787856999.780079:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe80fc00 x1874703436433920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856999.780092:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1874703436433920:0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.780106:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436433536:0@lo:400:kworker.0 00000100:00100000:3.0:1787856999.780122:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436434048:0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.780511:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874703436433792:0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.780525:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436433152:0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.780536:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436433664:0@lo:400:kworker.0 00010000:00080000:0.0:1787856999.780547:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9065fe80f0c0 x1874703436434176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787856999.780556:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436434176:0@lo:400:kworker.0 00000100:00100000:0.0:1787856999.780579:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436433280:0@lo:400:kworker.0 00010000:00010000:0.0:1787857000.165631:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787857000.275074:0:17154:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a956236f-01aa-4d39-8628-24f029cf1eae 00000001:00100000:2.0:1787857000.275091:0:17154:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 54732495-c2d9-4110-96c9-7cc6d03017e0 00000001:00100000:0.0:1787857000.284064:0:17906:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a956236f-01aa-4d39-8628-24f029cf1eae 00000001:00100000:0.0:1787857000.284093:0:17906:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 54732495-c2d9-4110-96c9-7cc6d03017e0 00000001:00100000:3.0:1787857000.284306:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a956236f-01aa-4d39-8628-24f029cf1eae 00000001:00100000:3.0:1787857000.284316:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54732495-c2d9-4110-96c9-7cc6d03017e0 00000001:02000400:2.0:1787857000.601975:0:20052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787857001.172160:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857001.297540:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857001.297573:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436434304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787857001.297668:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857001.297811:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436434304 00000100:00100000:0.0:1787857001.297821:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436434304 00000100:00100000:0.0:1787857001.297904:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787857001.297918:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436434304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787857001.297958:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787857001.298017:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436434304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857001.298024:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787857001.298095:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436434304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787857001.298243:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857001.809553:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436434432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787857001.809657:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857001.809793:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436434432 00000100:00100000:1.0:1787857001.809803:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436434432 00000100:00100000:1.0:1787857001.809870:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787857001.809890:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436434432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787857001.809940:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787857001.812322:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436434432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2417us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857001.812342:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787857001.817179:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c5d6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436434432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787857001.817611:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436434560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787857001.817697:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857001.824594:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436434560 00000100:00100000:3.0:1787857001.824616:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436434560 00000100:00100000:3.0:1787857001.824700:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787857001.824712:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436434560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787857001.824765:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787857001.824891:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436434560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (7193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857001.827570:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787857001.827701:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436434560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787857002.193513:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857002.460624:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460676:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460702:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460720:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460737:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460772:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460789:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460809:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857002.460838:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426908032 00000100:00100000:1.0:1787857002.460851:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426908032 00000100:00100000:1.0:1787857002.460911:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426908544 00000100:00100000:1.0:1787857002.460914:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426908544 00000100:00100000:1.0:1787857002.460925:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426907904 00000100:00100000:1.0:1787857002.460928:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426907904 00000100:00100000:1.0:1787857002.460942:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426908416 00000100:00100000:1.0:1787857002.460945:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426908416 00000100:00100000:1.0:1787857002.460963:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1787857002.460974:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426908032:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857002.461071:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426908032:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 98us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857002.461080:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1787857002.461101:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:1.0:1787857002.461108:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426908544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857002.461131:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426908544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857002.461137:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:1.0:1787857002.461148:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:1.0:1787857002.461176:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2401:x1874703426907904:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857002.461200:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2401:x1874703426907904:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857002.461207:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:1.0:1787857002.461246:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:1.0:1787857002.461254:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+6:2401:x1874703426908416:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857002.461275:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+6:2401:x1874703426908416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857002.461282:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:1.0:1787857002.461300:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426908288 00000100:00100000:1.0:1787857002.461304:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426908288 00000100:00100000:1.0:1787857002.461325:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426908800 00000100:00100000:1.0:1787857002.461327:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426908800 00000100:00100000:1.0:1787857002.461338:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426908160 00000100:00100000:1.0:1787857002.461340:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426908160 00000100:00100000:2.0:1787857002.461489:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426907776 00000100:00100000:2.0:1787857002.461494:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426907776 00000100:00100000:2.0:1787857002.461528:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:2.0:1787857002.461535:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:2401:x1874703426907776:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787857002.461562:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:2401:x1874703426907776:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857002.461569:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:1.0:1787857002.462451:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426908672 00000100:00100000:1.0:1787857002.462458:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426908672 00000100:00100000:1.0:1787857002.462477:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1787857002.462486:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426908288:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857002.462523:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426908288:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857002.462530:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1787857002.462544:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:1.0:1787857002.462551:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956236f-01aa-4d39-8628-24f029cf1eae+6:2401:x1874703426908800:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857002.462574:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956236f-01aa-4d39-8628-24f029cf1eae+6:2401:x1874703426908800:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857002.462590:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:1.0:1787857002.462603:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1787857002.462609:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426908160:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857002.462633:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426908160:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857002.462639:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1787857002.462652:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1787857002.462659:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426908672:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857002.462676:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426908672:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 18us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857002.462682:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00080000:1.0:1787857002.462721:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857002.462727:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857002.462731:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857002.462733:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1787857002.897943:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787857003.219650:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787857003.354003:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a956236f-01aa-4d39-8628-24f029cf1eae 00000020:00000080:2.0:1787857003.747034:0:20200:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd52f91510 20000000:00000080:2.0:1787857003.747061:0:20200:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9065fd249c00 uarg=0000000000000000 20000000:01000000:2.0:1787857003.747842:0:20200:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787857003.747851:0:20200:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787857003.747859:0:20200:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787857003.748982:0:20201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787857003.749311:0:20200:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787857003.760907:0:20200:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787857003.761733:0:20200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761763:0:20200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761791:0:20200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761799:0:20200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761806:0:20200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761817:0:20200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761824:0:20200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761833:0:20200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761894:0:20200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.761913:0:20200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 12 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857003.761931:0:20200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436434688:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787857003.762093:0:20200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.762102:0:20200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 12 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857003.762129:0:20200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436434816:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787857003.762181:0:20200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.762190:0:20200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 23 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857003.762200:0:20200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436434944:0@lo:104: 00000100:00100000:3.0:1787857003.773758:0:20200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857003.773884:0:20200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.773904:0:20200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 23 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857003.773921:0:20200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436435072:0@lo:104: 00000100:00100000:3.0:1787857003.773976:0:20200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857003.774011:0:20200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.774020:0:20200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 23 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857003.774029:0:20200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436435200:0@lo:104: 00000100:00100000:3.0:1787857003.774052:0:20200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857003.774070:0:20200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.774104:0:20200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 23 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857003.774114:0:20200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436435328:0@lo:104: 00000100:00100000:3.0:1787857003.774161:0:20200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857003.774174:0:20200:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f734ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857003.774578:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436434944 00000100:00100000:0.0:1787857003.774589:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436434944 00000100:00100000:0.0:1787857003.774644:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436435072 00000100:00100000:0.0:1787857003.774648:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436435072 00000100:00100000:0.0:1787857003.774660:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436435200 00000100:00100000:0.0:1787857003.774662:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436435200 00000100:00100000:0.0:1787857003.774672:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436435328 00000100:00100000:0.0:1787857003.774674:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436435328 00000100:00100000:0.0:1787857003.774689:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857003.774699:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+6:20200:x1874703436434944:12345-0@lo:104: 00010000:00010000:0.0:1787857003.774715:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.774784:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857003.774791:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+6:20200:x1874703436434944:12345-0@lo:104: Request processed in 93us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.774798:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857003.774823:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787857003.774829:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+5:20200:x1874703436435072:12345-0@lo:104: 00010000:00010000:0.0:1787857003.774838:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.774891:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787857003.774896:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+5:20200:x1874703436435072:12345-0@lo:104: Request processed in 68us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.774904:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787857003.774917:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787857003.774923:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+4:20200:x1874703436435200:12345-0@lo:104: 00010000:00010000:0.0:1787857003.774931:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.774965:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787857003.774970:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+4:20200:x1874703436435200:12345-0@lo:104: Request processed in 47us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.774976:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787857003.774988:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787857003.774994:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:20200:x1874703436435328:12345-0@lo:104: 00010000:00010000:0.0:1787857003.775002:0:17157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775028:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787857003.775033:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+3:20200:x1874703436435328:12345-0@lo:104: Request processed in 39us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.775038:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787857003.775058:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787857003.775065:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775085:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe200 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787857003.775090:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775100:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857003.775108:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857003.775114:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787857003.775175:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775183:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857003.775209:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775243:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9065fd5fe200/0xc25410d92a3c4f26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4f2d expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775261:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787857003.775265:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775271:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939e00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787857003.775274:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775293:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857003.775300:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857003.775306:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787857003.775322:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775329:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857003.775336:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775343:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601939e00/0xc25410d92a3c4dc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4dc8 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775353:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787857003.775586:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775593:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939a00 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787857003.775596:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775604:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857003.775611:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857003.775626:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787857003.775655:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775662:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857003.775684:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775691:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601939a00/0xc25410d92a3c4d82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d89 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775701:0:17163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857003.775704:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775710:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1414c20) 10000000:00010000:0.0:1787857003.775713:0:17163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775720:0:17163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857003.775726:0:17163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857003.775731:0:17163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787857003.775745:0:17163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775751:0:17163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857003.775765:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775772:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff906601939000/0xc25410d92a3c4d74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc25410d92a3c4d7b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.775788:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857003.775790:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857003.775792:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857003.775801:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857003.775808:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857003.775827:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3623:1874703436435456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857003.775883:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857003.775930:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857003.775936:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3623:1874703436435584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857003.775958:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857003.775993:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436435712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857003.776038:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857003.776058:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857003.776065:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436435840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857003.776085:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857003.776113:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436435456 00000100:00100000:1.0:1787857003.776314:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857003.776418:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857003.777554:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436435456 00010000:00010000:0.0:1787857003.777610:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 24 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857003.777643:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436435584 00000100:00100000:0.0:1787857003.777646:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436435584 00010000:00010000:0.0:1787857003.777659:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 25 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857003.777686:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436435712 00000100:00100000:0.0:1787857003.777690:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436435712 00010000:00010000:0.0:1787857003.777703:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 26 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857003.777714:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436435840 00000100:00100000:0.0:1787857003.777716:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436435840 00010000:00010000:0.0:1787857003.777725:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 27 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857003.777734:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426908928 00000100:00100000:0.0:1787857003.777736:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426908928 00010000:00010000:0.0:1787857003.777748:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 13 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857003.777757:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426909056 00000100:00100000:0.0:1787857003.777760:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426909056 00010000:00010000:0.0:1787857003.777770:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 14 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857003.777784:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857003.777792:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+27:3623:x1874703436435456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857003.777809:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857003.777814:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 27 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.777826:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 27 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.777851:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857003.778041:0:20200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436434688:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787857003.778056:0:20200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436434816:192.168.202.6@tcp:104: 00010000:00010000:3.0:1787857003.778067:0:20200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9066007bb200/0xc25410d92a3c4f2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4f26 expref: 27 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857003.778082:0:20200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436434944:0@lo:104: 00000100:00100000:3.0:1787857003.778092:0:20200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436435072:0@lo:104: 00000100:00100000:3.0:1787857003.778102:0:20200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436435200:0@lo:104: 00000100:00100000:3.0:1787857003.778111:0:20200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20200:1874703436435328:0@lo:104: 00010000:00010000:3.0:1787857003.778173:0:20200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857003.779510:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+26:3623:x1874703436435456:12345-0@lo:103:ldlm_bl.0 Request processed in 1709us (3618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.779526:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857003.779567:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787857003.779585:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+25:3623:x1874703436435584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857003.779607:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857003.779614:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 25 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779629:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 25 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779649:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065fd5ffe00/0xc25410d92a3c4dc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4dc1 expref: 25 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779666:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857003.779727:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3623:x1874703436435584:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.779735:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787857003.779749:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787857003.779755:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:3625:x1874703436435712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857003.779763:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857003.779768:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 23 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779777:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 23 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779788:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906601939c00/0xc25410d92a3c4d89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4d82 expref: 23 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779813:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857003.779848:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:3625:x1874703436435712:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (3809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.779855:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787857003.779867:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787857003.779874:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:3625:x1874703436435840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857003.779881:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857003.779886:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 21 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779895:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 21 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779906:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90660215a200/0xc25410d92a3c4d7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc25410d92a3c4d74 expref: 21 pid: 17167 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779915:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857003.779938:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:3625:x1874703436435840:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.779945:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787857003.779962:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:0.0:1787857003.779970:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660068b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90f35eb6-658b-49d5-8d30-9116022ee9f3+14:2402:x1874703426908928:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857003.779980:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857003.779985:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 14 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.779995:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 14 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780013:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274be00/0xc25410d92a3c50b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63a9 expref: 14 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780023:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857003.780080:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660068b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:2402:x1874703426908928:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 110us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.780087:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:0.0:1787857003.780136:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1787857003.780155:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:2402:x1874703426909056:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857003.780164:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857003.780169:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 12 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780179:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 12 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780190:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9066007ba000/0xc25410d92a3c5076 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6339 expref: 12 pid: 17166 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780203:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780214:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780260:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780281:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780289:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780297:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780304:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274bc00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787857003.780308:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780319:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780335:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857003.780348:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857003.780943:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436435840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857003.780956:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3625:1874703436435712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857003.781414:0:20200:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.781426:0:20200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857003.781432:0:20200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c50e6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857003.786557:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c5d6a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:2402:x1874703426909056:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 6384us (10121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857003.786576:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1787857003.791676:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3623:1874703436435456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857003.793849:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3623:1874703436435584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857004.242432:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857004.371886:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436435968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857004.372013:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857004.372200:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436435968 00000100:00100000:1.0:1787857004.372212:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436435968 00000100:00100000:1.0:1787857004.372328:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787857004.372338:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436435968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857004.372406:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787857004.372545:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857004.383549:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436435968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11196us (11521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857004.383570:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787857004.383914:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436435968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857004.883787:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436436096:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.883871:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8360b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436436224:0@lo:400:kworker.0 00000100:00100000:1.0:1787857004.883883:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857004.883936:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436436608:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.883947:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857004.883982:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857004.883994:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8362d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436436736:0@lo:400:kworker.0 00000100:00100000:1.0:1787857004.884014:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436437120:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.884076:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857004.884077:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857004.884125:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436437248:0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.884281:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8360f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436436480:0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.884327:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436436224 00000100:00100000:3.0:1787857004.884335:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436436224 00000100:00100000:3.0:1787857004.884393:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436436608 00000100:00100000:3.0:1787857004.884396:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436436608 00000100:00100000:3.0:1787857004.884414:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787857004.884424:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436436224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.884487:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436436224:12345-0@lo:400:kworker.0 Request processed in 63us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857004.884494:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787857004.884513:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787857004.884519:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436436608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.884549:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436436608:12345-0@lo:400:kworker.0 Request processed in 31us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857004.884555:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787857004.888010:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436437632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857004.888085:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857004.888699:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436436096 00000100:00100000:0.0:1787857004.888718:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436436096 00000100:00100000:0.0:1787857004.888800:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787857004.888812:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:3624:x1874703436436096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.888915:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:3624:x1874703436436096:12345-0@lo:400:kworker.0 Request processed in 105us (5033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857004.888924:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787857004.888980:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436436352:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.889022:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857004.889051:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8362580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436436864:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.889249:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857004.889271:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8361680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436437376:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.889299:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857004.889327:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857004.889334:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436437760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787857004.889358:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857004.889387:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857004.889438:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8360b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436436224:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.889605:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436437632 00000100:00100000:0.0:1787857004.889610:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436437632 00000100:00100000:1.0:1787857004.890597:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436436096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857004.890629:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436436608:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.890651:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436437760 00000100:00100000:0.0:1787857004.890659:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436437760 00000100:00100000:1.0:1787857004.890703:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436436736 00000100:00100000:1.0:1787857004.890713:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436436736 00000100:00080000:2.0:1787857004.890755:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857004.890785:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857004.890839:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787857004.890849:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436437632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857004.890900:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787857004.891103:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436437120 00000100:00100000:3.0:1787857004.891109:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436437120 00000100:00100000:3.0:1787857004.891167:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436437376 00000100:00100000:3.0:1787857004.891171:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436437376 00000100:00100000:3.0:1787857004.891187:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436437248 00000100:00100000:3.0:1787857004.891190:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436437248 00000100:00100000:3.0:1787857004.891246:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787857004.891254:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436437120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787857004.891336:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787857004.891340:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857004.891635:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436436352 00000100:00100000:1.0:1787857004.891646:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436436352 00000100:00100000:0.0:1787857004.891658:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874703436437632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 807us (3574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857004.891669:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787857004.891679:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436436864 00000100:00100000:1.0:1787857004.891684:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436436864 00000100:00100000:0.0:1787857004.891703:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787857004.891722:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1874703436437760:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787857004.891723:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787857004.891744:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065e94a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436436736:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787857004.891746:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787857004.892123:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065fe80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436437760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787857004.892315:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787857004.892326:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436436352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.892368:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1874703436437760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 658us (3010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857004.892374:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787857004.892396:0:17172:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787857004.892404:0:17172:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787857004.892420:0:18998:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787857004.892424:0:18998:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787857004.893023:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065e94a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436436736:12345-0@lo:400:kworker.0 Request processed in 1278us (8953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857004.893037:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787857004.894066:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787857004.894082:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436436864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.894565:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436437632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857004.894588:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436437120:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.894648:0:17176:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787857004.894664:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787857004.894675:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436437376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.894767:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874703436437376:12345-0@lo:400:kworker.0 Request processed in 94us (5467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857004.894776:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787857004.894802:0:17176:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787857004.894808:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787857004.894816:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857004.894895:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436436864:12345-0@lo:400:kworker.0 Request processed in 813us (5639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857004.894910:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436437120:12345-0@lo:400:kworker.0 Request processed in 3653us (10843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857004.894911:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787857004.894932:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787857004.894983:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857004.895024:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8362d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436436736:0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895028:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8363840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436436992:0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895088:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857004.895104:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436437504:0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895142:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857004.895172:0:17175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857004.895179:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436436480 00000100:00100000:3.0:1787857004.895187:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436436480 00000100:00100000:3.0:1787857004.895213:0:17175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857004.895230:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436436992 00000100:00100000:3.0:1787857004.895232:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436436992 00000100:00100000:3.0:1787857004.895238:0:17175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857004.895240:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436437504 00000100:00100000:3.0:1787857004.895242:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436437504 00000100:00100000:3.0:1787857004.895260:0:17175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857004.895265:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787857004.895269:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895304:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436436480:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857004.895309:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787857004.895317:0:17175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857004.895322:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787857004.895326:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436436992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895359:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436436992:12345-0@lo:400:kworker.0 Request processed in 33us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857004.895362:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787857004.895369:0:17175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857004.895372:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787857004.895375:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436437504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895388:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436437504:12345-0@lo:400:kworker.0 Request processed in 13us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857004.895391:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787857004.895411:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8360f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436436480:0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895417:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8363840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436436992:0@lo:400:kworker.0 00010000:00080000:3.0:1787857004.895426:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8360000 x1874703436437504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857004.895433:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436437504:0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895468:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8362580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436436864:0@lo:400:kworker.0 00000100:00100000:3.0:1787857004.895480:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8361680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874703436437376:0@lo:400:kworker.0 00000100:00080000:3.0:1787857004.895546:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787857004.896336:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436437248:12345-0@lo:400:kworker.0 Request processed in 1516us (6942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857004.896353:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787857004.896494:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436436352:12345-0@lo:400:kworker.0 Request processed in 4168us (7468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857004.896506:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787857004.896627:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c83612c0 x1874703436437248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857004.896641:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436437248:0@lo:400:kworker.0 00000100:00100000:0.0:1787857004.896728:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436436352:0@lo:400:kworker.0 10000000:01000000:2.0:1787857005.265314:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787857005.265322:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9064c10ae000 from 13 10000000:01000000:2.0:1787857005.265327:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787857005.265376:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c50ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857005.265389:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c50ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857005.265400:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c50ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857005.265429:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436437888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857005.265528:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857005.265575:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857005.265673:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436437888 00000100:00100000:1.0:1787857005.265682:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436437888 00000100:00100000:1.0:1787857005.265744:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787857005.265754:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+20:17170:x1874703436437888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857005.265766:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857005.265848:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601939800/0xc25410d92a3c50f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c50ed expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.265876:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601939800/0xc25410d92a3c50f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c50ed expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.265888:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601939800/0xc25410d92a3c50f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c50ed expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.265898:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939800, rc 0) 00000100:00100000:1.0:1787857005.265951:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436437888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.265959:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00010000:3.0:1787857005.265968:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857005.266012:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436437888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857005.266027:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c50ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c50f4 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.266049:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c50ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c50f4 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857005.266108:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8362d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.266148:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.266172:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c78eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857005.266213:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436438016 00000100:00100000:3.0:1787857005.266244:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436438016 00000100:00100000:3.0:1787857005.266280:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787857005.266288:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436438016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857005.266420:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436438016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857005.266428:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787857005.266562:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8362d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857005.266589:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857005.266627:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857005.266657:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857005.266711:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436438144 00000100:00100000:1.0:1787857005.266716:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436438144 00000100:00100000:1.0:1787857005.266830:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787857005.266838:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436438144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.266917:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436438144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.266924:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787857005.269606:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787857005.270825:0:20266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787857005.276502:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787857005.276543:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787857005.276556:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c50ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c50f4 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857005.276568:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215bc00/0xc25410d92a3c50ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c50f4 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857005.276580:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787857005.276583:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065dfae1800 from 13 10000000:01000000:2.0:1787857005.276586:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787857005.276625:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c50fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857005.276633:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c50fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857005.276644:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c50fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857005.276667:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857005.276735:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857005.276785:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857005.276841:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436438272 00000100:00100000:3.0:1787857005.276848:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436438272 00000100:00100000:3.0:1787857005.276905:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787857005.276914:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+21:17170:x1874703436438272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857005.276927:0:17168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857005.276940:0:17168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274aa00/0xc25410d92a3c5102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c50fb expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857005.276963:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274aa00/0xc25410d92a3c5102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c50fb expref: 22 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857005.276974:0:17168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274aa00/0xc25410d92a3c5102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c50fb expref: 22 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857005.276982:0:17168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274aa00, rc 0) 00000100:00100000:3.0:1787857005.277022:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:17170:x1874703436438272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857005.277028:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787857005.277118:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857005.277147:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c50fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c5102 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.277156:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c50fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c5102 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857005.277210:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.277285:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.277303:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c78eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857005.277316:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436438400 00000100:00100000:1.0:1787857005.277319:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436438400 00000100:00100000:1.0:1787857005.277359:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787857005.277366:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:17170:x1874703436438400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.277474:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:17170:x1874703436438400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.277481:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787857005.277515:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.277542:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.277584:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.277598:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c78eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857005.277609:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436438528 00000100:00100000:1.0:1787857005.277613:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436438528 00000100:00100000:1.0:1787857005.277634:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787857005.277640:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:17170:x1874703436438528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.277710:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:17170:x1874703436438528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.277717:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787857005.277756:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787857005.278500:0:20268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787857005.278571:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787857005.278590:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857005.278598:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c50fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c5102 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.278608:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff90660215b000/0xc25410d92a3c50fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c5102 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857005.278632:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787857005.278635:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065fe85c800 from 13 10000000:01000000:1.0:1787857005.278637:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857005.278664:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c5109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.278672:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c5109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.278681:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c5109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857005.278697:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.278737:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.278756:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f734fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857005.278772:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436438656 00000100:00100000:1.0:1787857005.278776:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436438656 00000100:00100000:1.0:1787857005.278805:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787857005.278811:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+22:17170:x1874703436438656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857005.278820:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857005.278830:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601938000/0xc25410d92a3c5110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c5109 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.278848:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601938000/0xc25410d92a3c5110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c5109 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.278858:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601938000/0xc25410d92a3c5110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c5109 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.278877:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938000, rc 0) 00000100:00100000:1.0:1787857005.278907:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436438656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.278913:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787857005.278948:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857005.278962:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c5109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c5110 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.278971:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c5109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c5110 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857005.279011:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.279033:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.279045:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f734fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857005.279056:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436438784 00000100:00100000:1.0:1787857005.279059:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436438784 00000100:00100000:1.0:1787857005.279078:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787857005.279083:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436438784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.279178:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436438784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.279185:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787857005.279213:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.279264:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.279302:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.279322:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065f734fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857005.279333:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436438912 00000100:00100000:1.0:1787857005.279336:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436438912 00000100:00100000:1.0:1787857005.279355:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787857005.279361:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436438912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.279433:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436438912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.279438:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787857005.279818:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436438912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787857005.281068:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787857005.281565:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787857005.281589:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857005.281599:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c5109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c5110 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.281611:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601938800/0xc25410d92a3c5109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c5110 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857005.281623:0:17170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787857005.281625:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9065c52b7000 from 13 10000000:01000000:1.0:1787857005.281629:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857005.281659:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c5117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.281668:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c5117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.281680:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c5117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857005.281702:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436439040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.281770:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.281821:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857005.281874:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436439040 00000100:00100000:2.0:1787857005.281880:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436439040 00000100:00100000:2.0:1787857005.281928:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787857005.281937:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+23:17170:x1874703436439040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857005.281947:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857005.281959:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90660215ae00/0xc25410d92a3c511e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc25410d92a3c5117 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857005.281994:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90660215ae00/0xc25410d92a3c511e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc25410d92a3c5117 expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857005.282004:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90660215ae00/0xc25410d92a3c511e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc25410d92a3c5117 expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857005.282012:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660215ae00, rc 0) 00000100:00100000:2.0:1787857005.282059:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:17170:x1874703436439040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857005.282066:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787857005.282571:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436439040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857005.282592:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c5117 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c511e expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.282603:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c5117 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc25410d92a3c511e expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857005.282668:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436439168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.282700:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.282733:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857005.282779:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436439168 00000100:00100000:2.0:1787857005.282784:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436439168 00000100:00100000:2.0:1787857005.282820:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787857005.282827:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:17170:x1874703436439168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857005.282942:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:17170:x1874703436439168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857005.282949:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787857005.283264:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436439168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.283298:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436439296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.283347:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857005.283367:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857005.286072:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436439296 00000100:00100000:3.0:1787857005.286097:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436439296 00000100:00100000:3.0:1787857005.286174:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787857005.286185:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:17170:x1874703436439296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857005.286510:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:17170:x1874703436439296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 327us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857005.286518:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787857005.286770:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:17170:1874703436439296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787857005.292943:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787857005.293018:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787857005.293041:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787857005.293052:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c5117 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c511e expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857005.293065:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff906601938a00/0xc25410d92a3c5117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc25410d92a3c511e expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857005.341205:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857005.343614:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426909184 00000100:00100000:3.0:1787857005.343630:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426909184 00000100:00100000:3.0:1787857005.343784:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 162 00000100:00100000:3.0:1787857005.343796:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+11:14919:x1874703426909184:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857005.343813:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857005.343831:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c5125 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a63e1 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857005.343861:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c5125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63e1 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857005.343872:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9065d274bc00/0xc25410d92a3c5125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63e1 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857005.343900:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274bc00, rc 0) 00000100:00100000:3.0:1787857005.343966:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:14919:x1874703426909184:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 172us (4758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857005.343973:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 162 00000100:00100000:1.0:1787857005.352473:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857005.352558:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426909312 00000100:00100000:3.0:1787857005.352568:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426909312 00000100:00100000:3.0:1787857005.352623:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 163 00000100:00100000:3.0:1787857005.352632:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:14919:x1874703426909312:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857005.352797:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:14919:x1874703426909312:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 165us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857005.352805:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 163 00000100:00100000:2.0:1787857005.357718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857005.357869:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426909440 00000100:00100000:3.0:1787857005.357879:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426909440 00000100:00100000:3.0:1787857005.357964:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:3.0:1787857005.357974:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:14919:x1874703426909440:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857005.358121:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:14919:x1874703426909440:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 148us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857005.358137:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:3.0:1787857005.365751:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857005.365891:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426909568 00000100:00100000:1.0:1787857005.365901:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426909568 00000100:00100000:1.0:1787857005.366070:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:1.0:1787857005.366081:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+12:14919:x1874703426909568:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857005.366098:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857005.366116:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906601939200/0xc25410d92a3c512c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a63e8 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.366169:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906601939200/0xc25410d92a3c512c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63e8 expref: 13 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.366179:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906601939200/0xc25410d92a3c512c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63e8 expref: 13 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857005.366186:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939200, rc 0) 00000100:00100000:1.0:1787857005.366276:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:14919:x1874703426909568:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 198us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.366282:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:1.0:1787857005.367655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857005.367730:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426909696 00000100:00100000:3.0:1787857005.367736:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426909696 00000100:00100000:3.0:1787857005.367815:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:3.0:1787857005.367822:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:14919:x1874703426909696:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857005.367938:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:14919:x1874703426909696:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 117us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857005.367953:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:3.0:1787857005.369659:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857005.369754:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426909824 00000100:00100000:1.0:1787857005.369761:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426909824 00000100:00100000:1.0:1787857005.369843:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:1.0:1787857005.369850:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:14919:x1874703426909824:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857005.369960:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:14919:x1874703426909824:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 110us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857005.369965:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 167 00010000:00010000:0.0:1787857006.289860:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857006.419988:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857006.420014:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436439424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787857006.420086:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857006.420403:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436439424 00000100:00100000:0.0:1787857006.420412:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436439424 00000100:00100000:0.0:1787857006.420477:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787857006.420487:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436439424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787857006.420517:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787857006.420564:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436439424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857006.420572:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787857006.422540:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436439424:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787857006.422648:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787857006.738198:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787857006.929502:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857006.936679:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436439680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787857006.936790:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857006.936845:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436439552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787857006.936870:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857006.939552:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436439680 00000100:00100000:3.0:1787857006.939572:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436439680 00000100:00100000:3.0:1787857006.939650:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436439552 00000100:00100000:3.0:1787857006.939655:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436439552 00000100:00100000:3.0:1787857006.939677:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787857006.939686:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436439680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787857006.939739:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787857006.939860:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874703436439680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857006.939869:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787857006.939888:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787857006.939895:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436439552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787857006.939913:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787857006.939947:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436439552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857006.939953:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787857006.940277:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff906601a3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874703436439680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787857006.940293:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436439552:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787857007.314807:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857007.579303:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857007.579399:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857007.579434:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.579455:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426910336 00000100:00100000:3.0:1787857007.579465:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.579466:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426910336 00000100:00100000:3.0:1787857007.579493:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857007.579511:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.579525:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426910848 00000100:00100000:3.0:1787857007.579527:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.579553:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426910848 00000100:00100000:3.0:1787857007.579559:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.579576:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426910464 00000100:00100000:1.0:1787857007.579579:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426910464 00000100:00100000:3.0:1787857007.579580:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.579591:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426910976 00000100:00100000:1.0:1787857007.579594:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426910976 00000100:00100000:3.0:1787857007.579596:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426909952 00000100:00100000:3.0:1787857007.579598:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426909952 00000100:00100000:1.0:1787857007.579609:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:3.0:1787857007.579621:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:3.0:1787857007.579630:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:2401:x1874703426909952:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857007.579631:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426910336:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1787857007.579721:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426910080 00000100:00100000:2.0:1787857007.579725:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426910080 00000100:00100000:2.0:1787857007.579750:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426910592 00000100:00100000:2.0:1787857007.579753:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426910592 00000100:00100000:2.0:1787857007.579768:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426910208 00000100:00100000:2.0:1787857007.579770:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426910208 00000100:00100000:2.0:1787857007.579780:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426910720 00000100:00100000:2.0:1787857007.579783:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426910720 00000100:00100000:2.0:1787857007.579795:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1787857007.579801:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2401:x1874703426910080:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787857007.579868:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:2401:x1874703426909952:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 238us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857007.579877:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:3.0:1787857007.579913:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:3.0:1787857007.579920:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426910848:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1787857007.580168:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1787857007.580179:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:2401:x1874703426910592:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857007.584601:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426910336:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 4958us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.584619:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1787857007.584664:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:1.0:1787857007.584680:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426910464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857007.584731:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426910464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 59us (5203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.584738:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:1.0:1787857007.584751:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1787857007.584758:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426910976:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857007.584781:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426910976:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (5200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.584786:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1787857007.584832:0:20238:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787857007.584840:0:20238:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787857007.584958:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:1.0:1787857007.584966:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426910208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857007.584996:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426910208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (5483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.585019:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:1.0:1787857007.585034:0:20238:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787857007.585041:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:1.0:1787857007.585048:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426910720:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857007.585073:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426910720:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (5513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.585080:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1787857007.586265:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2401:x1874703426910080:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 6454us (6962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857007.586276:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00080000:2.0:1787857007.586355:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787857007.586360:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857007.586363:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857007.586367:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857007.589913:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956236f-01aa-4d39-8628-24f029cf1eae+5:2401:x1874703426910848:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 9974us (10426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857007.589932:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1787857007.596014:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065fe80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:2401:x1874703426910592:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 15823us (16565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857007.596060:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1787857007.603621:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.604598:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426911104 00000100:00100000:1.0:1787857007.604610:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426911104 00000100:00100000:1.0:1787857007.604685:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1787857007.604695:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+6:15585:x1874703426911104:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857007.604716:0:20238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857007.604740:0:20238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c5133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a63ef expref: -99 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604811:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604835:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604848:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604862:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604870:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604892:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604967:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938600/0xc25410d92a3c5148 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604975:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601938600/0xc25410d92a3c5148 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.604982:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601938600/0xc25410d92a3c5148 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857007.605010:0:20238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787857007.605014:0:20238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787857007.605050:0:20238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601938600/0xc25410d92a3c5148 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605061:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605067:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605073:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605079:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939a00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787857007.605083:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605090:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605120:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:1.0:1787857007.605123:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857007.605129:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605135:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c513a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605150:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605156:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605162:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605168:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939e00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787857007.605170:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605176:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605188:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9065c4a2a700) 00010000:00010000:1.0:1787857007.605189:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857007.605192:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605196:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5141 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605295:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c5133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63ef expref: 8 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605308:0:20238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601938600/0xc25410d92a3c5148 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63ef expref: 7 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.605315:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9065c4a2a500) 00010000:00010000:1.0:1787857007.605317:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857007.605319:0:20238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601938600, rc 0) 00000100:00100000:1.0:1787857007.605391:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+7:15585:x1874703426911104:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 697us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.605399:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1787857007.628815:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857007.629020:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426911232 00000100:00100000:2.0:1787857007.629040:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426911232 00000100:00100000:2.0:1787857007.629118:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1787857007.629128:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:54732495-c2d9-4110-96c9-7cc6d03017e0+7:15585:x1874703426911232:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787857007.629271:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:54732495-c2d9-4110-96c9-7cc6d03017e0+7:15585:x1874703426911232:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 Request processed in 143us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857007.629281:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:3.0:1787857007.639420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857007.639810:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426911488 00000100:00100000:2.0:1787857007.639832:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426911488 00000100:00100000:2.0:1787857007.639917:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:2.0:1787857007.639929:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+7:15585:x1874703426911488:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857007.639952:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857007.639974:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c514f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a63f6 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640053:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640067:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640099:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640158:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640167:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640175:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640337:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a000/0xc25410d92a3c5164 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640346:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a000/0xc25410d92a3c5164 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640353:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a000/0xc25410d92a3c5164 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857007.640364:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787857007.640570:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640579:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640586:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640592:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215a200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857007.640603:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640613:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640627:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9065c4a2a500) 00010000:00010000:2.0:1787857007.640631:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857007.640636:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640643:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a200/0xc25410d92a3c5156 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640657:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640663:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640668:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640672:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660215b200 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857007.640675:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640681:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640687:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9064c73f6900) 00010000:00010000:2.0:1787857007.640689:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857007.640697:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.640704:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215b200/0xc25410d92a3c515d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.643514:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215a000/0xc25410d92a3c514f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63f6 expref: 10 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.643621:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076a000/0xc25410d92a3c5164 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63f6 expref: 9 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.643630:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9064c73f6700) 00010000:00010000:2.0:1787857007.643633:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857007.643637:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076a000, rc 0) 00000100:00100000:2.0:1787857007.643709:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+9:15585:x1874703426911488:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3782us (4304us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787857007.643718:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:3.0:1787857007.651386:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857007.651698:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426911616 00000100:00100000:0.0:1787857007.651712:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426911616 00000100:00100000:0.0:1787857007.651787:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1787857007.651799:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+9:15591:x1874703426911616:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787857007.652019:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857007.652127:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c5172 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a63fd expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652203:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652243:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652256:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652270:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652277:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652283:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652327:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652351:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652358:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652364:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007baa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787857007.652368:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652376:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.652388:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:0.0:1787857007.652391:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857007.652396:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857007.653828:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.654081:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426911744 00000100:00100000:1.0:1787857007.654111:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426911744 00010000:00010000:0.0:1787857007.654166:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c5179 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857007.654203:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00010000:00010000:0.0:1787857007.654205:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654235:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654243:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654249:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bb400 already unused, calling callback (ffffffffc1a254f0) 00000100:00100000:1.0:1787857007.654256:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+11:15585:x1874703426911744:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00010000:00010000:0.0:1787857007.654270:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654278:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654292:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9064c7953500) 00010000:00010000:0.0:1787857007.654295:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857007.654300:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654305:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c5180 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654350:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c5172 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63fd expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654361:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:0.0:1787857007.654365:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857007.654370:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c5172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63fd expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.654379:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bbc00, rc 0) 00000100:00100000:1.0:1787857007.654418:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+10:15585:x1874703426911744:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 202us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.654429:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:0.0:1787857007.654585:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+9:15591:x1874703426911616:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2785us (3213us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857007.654595:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1787857007.660942:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857007.661009:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857007.661079:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426911872 00000100:00100000:2.0:1787857007.661110:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426911872 00000100:00100000:2.0:1787857007.661197:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:2.0:1787857007.661208:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+5:15585:x1874703426911872:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857007.661342:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426912000 00000100:00100000:0.0:1787857007.661347:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426912000 00000100:00100000:0.0:1787857007.661386:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:0.0:1787857007.661396:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:54732495-c2d9-4110-96c9-7cc6d03017e0+9:15591:x1874703426912000:12345-192.168.202.6@tcp:700:lfs.0 00000100:00100000:0.0:1787857007.661518:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:54732495-c2d9-4110-96c9-7cc6d03017e0+9:15591:x1874703426912000:12345-192.168.202.6@tcp:700:lfs.0 Request processed in 120us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857007.661527:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000004:00080000:2.0:1787857007.662640:0:17172:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1351us 00000100:00100000:2.0:1787857007.667737:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.668086:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426912256 00000100:00100000:1.0:1787857007.668097:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426912256 00000100:00100000:1.0:1787857007.668177:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1787857007.668188:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+9:15591:x1874703426912256:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:1.0:1787857007.668268:0:20238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857007.668307:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c50a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a636a expref: 9 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.668327:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:1.0:1787857007.668332:0:20238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857007.668384:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.668398:0:20238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 5 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.668408:0:20238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.668441:0:20238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 5 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.668456:0:20238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 5 pid: 17172 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857007.668471:0:20238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8363480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20238:1874703436439808:192.168.202.6@tcp:104: 00000100:00100000:1.0:1787857007.668558:0:20238:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857007.671888:0:20238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8363480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20238:1874703436439808:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787857007.671924:0:20238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857007.683859:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.683965:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426912384 00000100:00100000:1.0:1787857007.683975:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426912384 00010000:00010000:1.0:1787857007.684021:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 6 pid: 17172 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857007.684085:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1787857007.684095:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a956236f-01aa-4d39-8628-24f029cf1eae+6:2402:x1874703426912384:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857007.684138:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857007.684145:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 6 pid: 17172 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.684160:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 6 pid: 17172 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.684195:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660215ba00/0xc25410d92a3c50df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a63da expref: 6 pid: 17172 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.684245:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:1.0:1787857007.684256:0:17160:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.684266:0:17160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.684274:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.684300:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857007.684347:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a956236f-01aa-4d39-8628-24f029cf1eae+5:2402:x1874703426912384:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 252us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.684355:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00010000:00010000:2.0:1787857007.684697:0:20238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.684706:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.684731:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.684741:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.684749:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.686952:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.686982:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.686995:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857007.687040:0:20238:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c006b880 reply state 000000008bb27c52 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687051:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687075:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:2.0:1787857007.687078:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787857007.687082:0:20238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787857007.687089:0:20238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787857007.687099:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687296:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687304:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687311:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939e00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857007.687315:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687323:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687336:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:2.0:1787857007.687339:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857007.687343:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687349:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c5187 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857007.687372:0:20238:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c006b880 reply state 000000008bb27c52 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687393:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.687400:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9064c73f6900) 00010000:00010000:2.0:1787857007.687403:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787857007.687405:0:20238:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787857007.687514:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+10:15591:x1874703426912256:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 19323us (19783us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787857007.687523:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1787857007.715991:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+5:15585:x1874703426911872:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 54767us (55048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857007.716726:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000040:00080000:0.0:1787857007.762547:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787857007.770198:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857007.771118:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426912512 00000100:00100000:0.0:1787857007.771136:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426912512 00000100:00100000:0.0:1787857007.771276:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:0.0:1787857007.771286:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+10:15599:x1874703426912512:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:0.0:1787857007.772337:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857007.772376:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c519c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6404 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.772466:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c51a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.772481:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c51a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.772493:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c51a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857007.772549:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787857007.772552:0:17175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787857007.772596:0:17175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c51a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.772647:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c519c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6404 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.772664:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb400/0xc25410d92a3c51a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6404 expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.772671:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7953500) 00010000:00010000:0.0:1787857007.772673:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857007.772676:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb400, rc 0) 00000100:00100000:0.0:1787857007.772784:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+11:15599:x1874703426912512:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 1499us (2600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857007.772794:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:1.0:1787857007.790658:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857007.791090:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426912640 00000100:00100000:0.0:1787857007.791116:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426912640 00000100:00100000:0.0:1787857007.791205:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:0.0:1787857007.791252:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956236f-01aa-4d39-8628-24f029cf1eae+5:15600:x1874703426912640:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787857007.791285:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857007.791403:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a640b expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.791508:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a600/0xc25410d92a3c51b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.791525:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a600/0xc25410d92a3c51b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.791562:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a600/0xc25410d92a3c51b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857007.791633:0:17176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787857007.791638:0:17176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787857007.791663:0:17176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a600/0xc25410d92a3c51b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.791695:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a640b expref: 7 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.791719:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a600/0xc25410d92a3c51b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a640b expref: 6 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.791729:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7953500) 00010000:00010000:3.0:1787857007.791733:0:17176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857007.791739:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274a600, rc 0) 00000100:00100000:3.0:1787857007.791830:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956236f-01aa-4d39-8628-24f029cf1eae+6:15600:x1874703426912640:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 614us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857007.791839:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1787857007.794917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.795440:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426912768 00000100:00100000:1.0:1787857007.795454:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426912768 00000100:00100000:1.0:1787857007.795534:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:1.0:1787857007.795545:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+6:15600:x1874703426912768:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787857007.795595:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857007.795622:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c51b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6412 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795713:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795732:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795747:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795771:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795780:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795788:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795892:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c51cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795901:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c51cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.795908:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c51cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857007.795959:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787857007.795970:0:17172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787857007.796000:0:17172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c51cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796017:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796025:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796033:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796158:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787857007.796164:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796173:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796188:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7953500) 00010000:00010000:1.0:1787857007.796191:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857007.796196:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796202:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939000/0xc25410d92a3c51bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796300:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796308:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796326:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796332:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906601939c00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787857007.796334:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796341:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796350:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9064c73f6900) 00010000:00010000:1.0:1787857007.796353:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857007.796356:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796362:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939c00/0xc25410d92a3c51c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796394:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939a00/0xc25410d92a3c51b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6412 expref: 8 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796409:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c51cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6412 expref: 7 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.796417:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:1.0:1787857007.796419:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857007.796422:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906601939e00, rc 0) 00000100:00100000:1.0:1787857007.796574:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+7:15600:x1874703426912768:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1029us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857007.796594:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:3.0:1787857007.800649:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857007.800738:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426912896 00000100:00100000:0.0:1787857007.800764:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426912896 00000100:00100000:0.0:1787857007.800844:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:0.0:1787857007.800856:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a956236f-01aa-4d39-8628-24f029cf1eae+5:15600:x1874703426912896:12345-192.168.202.6@tcp:900:lfs.0 00000100:00100000:0.0:1787857007.805175:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a956236f-01aa-4d39-8628-24f029cf1eae+5:15600:x1874703426912896:12345-192.168.202.6@tcp:900:lfs.0 Request processed in 4298us (4518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857007.805201:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1787857007.812801:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857007.812980:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426913152 00000100:00100000:2.0:1787857007.812992:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426913152 00000100:00100000:2.0:1787857007.813212:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:2.0:1787857007.813259:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+7:15600:x1874703426913152:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787857007.813290:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857007.813423:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b000/0xc25410d92a3c51d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6419 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857007.813578:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787857007.813723:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b000/0xc25410d92a3c51d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6419 expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.813743:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7953500) 00010000:00010000:2.0:1787857007.813747:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857007.813754:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b000/0xc25410d92a3c51d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6419 expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.813794:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b000, rc 0) 00000100:00100000:2.0:1787857007.813865:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956236f-01aa-4d39-8628-24f029cf1eae+8:15600:x1874703426913152:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 610us (1081us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787857007.813873:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:2.0:1787857007.817439:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857007.817624:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426913408 00000100:00100000:3.0:1787857007.817639:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426913408 00000100:00100000:3.0:1787857007.817705:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:3.0:1787857007.817716:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956236f-01aa-4d39-8628-24f029cf1eae+8:15600:x1874703426913408:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:3.0:1787857007.817831:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857007.817870:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906601939e00/0xc25410d92a3c51cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6412 expref: 8 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.817895:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:3.0:1787857007.817902:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857007.817933:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.817949:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.817961:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857007.818555:0:17176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a9ede6f reply state 000000002d505805 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.818574:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857007.818581:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:3.0:1787857007.818584:0:17176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787857007.818587:0:17176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787857007.818598:0:17176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787857007.818708:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956236f-01aa-4d39-8628-24f029cf1eae+9:15600:x1874703426913408:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 991us (1286us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787857007.818717:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:1.0:1787857007.822963:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857007.823432:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426913664 00000100:00100000:3.0:1787857007.823455:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426913664 00000100:00100000:3.0:1787857007.823563:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:3.0:1787857007.823576:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956236f-01aa-4d39-8628-24f029cf1eae+9:15600:x1874703426913664:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1787857007.823887:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956236f-01aa-4d39-8628-24f029cf1eae+10:15600:x1874703426913664:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 313us (938us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787857007.823896:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1787857007.827600:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.827745:0:20315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426913920 00000100:00100000:1.0:1787857007.827758:0:20315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426913920 00000100:00100000:1.0:1787857007.827829:0:20315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1787857007.827841:0:20315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a956236f-01aa-4d39-8628-24f029cf1eae+10:15600:x1874703426913920:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1787857007.827875:0:20315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857007.827906:0:20315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff600/0xc25410d92a3c51e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6420 expref: -99 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828005:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828023:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828191:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828209:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828396:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828407:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857007.828574:0:20315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787857007.828696:0:20315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828722:0:20315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828730:0:20315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828737:0:20315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787857007.828742:0:20315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828751:0:20315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828766:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7953500) 00010000:00010000:1.0:1787857007.828770:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857007.828775:0:20315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828782:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c51f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828800:0:20315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828806:0:20315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828812:0:20315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828817:0:20315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ff800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:1.0:1787857007.828826:0:20315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828833:0:20315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828840:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9064c73f6900) 00010000:00010000:1.0:1787857007.828843:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857007.828846:0:20315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828853:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c51f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828905:0:20315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff600/0xc25410d92a3c51e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6420 expref: 12 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828917:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7953500) 00010000:00010000:1.0:1787857007.828919:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857007.828923:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff600/0xc25410d92a3c51e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6420 expref: 12 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.828934:0:20315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff600, rc 0) 00000100:00100000:1.0:1787857007.829028:0:20315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a956236f-01aa-4d39-8628-24f029cf1eae+11:15600:x1874703426913920:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1189us (1442us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787857007.831970:0:20315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:3.0:1787857007.832211:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857007.832328:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426914048 00000100:00100000:0.0:1787857007.832362:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426914048 00000100:00100000:0.0:1787857007.832422:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:0.0:1787857007.832433:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956236f-01aa-4d39-8628-24f029cf1eae+11:15600:x1874703426914048:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1787857007.832466:0:20238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857007.832494:0:20238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c5205 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6427 expref: -99 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.832629:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.832647:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.832661:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857007.832691:0:20238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787857007.832695:0:20238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787857007.832722:0:20238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.832755:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c5205 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 13 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.832775:0:20238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 12 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.832786:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:0.0:1787857007.832789:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857007.832793:0:20238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007baa00, rc 0) 00000100:00100000:0.0:1787857007.833401:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956236f-01aa-4d39-8628-24f029cf1eae+12:15600:x1874703426914048:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 967us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857007.833410:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1787857007.837351:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.837528:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426914176 00000100:00100000:1.0:1787857007.837542:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426914176 00000100:00100000:1.0:1787857007.837623:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1787857007.837636:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956236f-01aa-4d39-8628-24f029cf1eae+12:15600:x1874703426914176:12345-192.168.202.6@tcp:37:lfs.0 00000100:00100000:2.0:1787857007.843378:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956236f-01aa-4d39-8628-24f029cf1eae+12:15600:x1874703426914176:12345-192.168.202.6@tcp:37:lfs.0 Request processed in 5728us (6029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857007.843396:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:3.0:1787857007.847305:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857007.847549:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426914432 00000100:00100000:2.0:1787857007.847564:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426914432 00000100:00100000:2.0:1787857007.847645:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1787857007.847658:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660045b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a956236f-01aa-4d39-8628-24f029cf1eae+12:15600:x1874703426914432:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787857007.847993:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660045b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a956236f-01aa-4d39-8628-24f029cf1eae+13:15600:x1874703426914432:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 337us (704us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787857007.848002:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:3.0:1787857007.903565:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.903705:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426914560 00000100:00100000:1.0:1787857007.903720:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426914560 00000100:00100000:1.0:1787857007.903805:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:1.0:1787857007.903816:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+11:15606:x1874703426914560:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787857007.903849:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857007.903966:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c5213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a642e expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904193:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904213:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904274:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904289:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904297:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904303:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904408:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c5228 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904420:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c5228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.904447:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c5228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857007.904687:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787857007.904693:0:17172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787857007.904842:0:17172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c5228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904861:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904868:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904888:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904895:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5ffa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857007.904900:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904910:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904925:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7953500) 00010000:00010000:2.0:1787857007.904928:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857007.904934:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904941:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ffa00/0xc25410d92a3c521a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904964:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904970:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904975:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904979:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fec00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857007.904982:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.904998:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.905006:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9064c73f6900) 00010000:00010000:2.0:1787857007.905008:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857007.905012:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.905017:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5221 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.905067:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c5213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a642e expref: 13 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.905084:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff200/0xc25410d92a3c5228 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a642e expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.905092:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:2.0:1787857007.905094:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857007.905294:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5ff200, rc 0) 00000100:00100000:2.0:1787857007.905403:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+12:15606:x1874703426914560:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1588us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857007.905413:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:1.0:1787857007.908808:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857007.909043:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426914688 00000100:00100000:3.0:1787857007.909057:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426914688 00000100:00100000:3.0:1787857007.909348:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1787857007.909362:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:15606:x1874703426914688:12345-192.168.202.6@tcp:900:bash.0 00000100:00100000:3.0:1787857007.909485:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:15606:x1874703426914688:12345-192.168.202.6@tcp:900:bash.0 Request processed in 126us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857007.909494:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1787857007.913365:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857007.913674:0:20315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426914944 00000100:00100000:1.0:1787857007.913688:0:20315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426914944 00000100:00100000:1.0:1787857007.913768:0:20315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:1.0:1787857007.913780:0:20315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+12:15606:x1874703426914944:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1787857007.913807:0:20315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857007.913832:0:20315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c522f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6435 expref: -99 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.913969:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.913989:0:20315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 12 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.913999:0:20315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.914044:0:20315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 12 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857007.914059:0:20315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 12 pid: 20238 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857007.914075:0:20315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20315:1874703436439936:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787857007.914655:0:20315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d0440f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857007.919583:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857007.919729:0:20315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c83612c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20315:1874703436439936:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787857007.919786:0:20315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857007.920162:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426915072 00000100:00100000:2.0:1787857007.920172:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426915072 00010000:00010000:2.0:1787857007.920248:0:17161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 13 pid: 20238 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857007.920421:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1787857007.920433:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a956236f-01aa-4d39-8628-24f029cf1eae+13:2402:x1874703426915072:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857007.920455:0:17161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857007.920464:0:17161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 13 pid: 20238 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.920477:0:17161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 13 pid: 20238 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.920506:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c520c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6427 expref: 13 pid: 20238 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.920525:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:2.0:1787857007.920530:0:17161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.920541:0:17161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.920551:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857007.920583:0:17161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857007.920652:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a956236f-01aa-4d39-8628-24f029cf1eae+12:2402:x1874703426915072:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 221us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857007.920660:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00010000:00010000:0.0:1787857007.921545:0:20315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.921557:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.921587:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.921599:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.921609:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922282:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922293:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922302:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857007.922439:0:20315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787857007.922476:0:20315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922483:0:20315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922491:0:20315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922497:0:20315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065fd5fe400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787857007.922501:0:20315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922508:0:20315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922520:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:0.0:1787857007.922523:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857007.922528:0:20315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922535:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fe400/0xc25410d92a3c5236 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857007.922550:0:20315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a13bf411 reply state 000000003c642b9a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922562:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922581:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9064c7953c00) 00010000:00010000:0.0:1787857007.922583:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787857007.922586:0:20315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857007.922636:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fea00/0xc25410d92a3c522f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 15 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922651:0:20315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 14 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.922659:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857007.922661:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787857007.922664:0:20315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb200, rc 0) 00000100:00100000:0.0:1787857007.922807:0:20315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+15:15606:x1874703426914944:12345-192.168.202.6@tcp:101:bash.0 Request processed in 9029us (9457us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787857007.922817:0:20315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:1.0:1787857007.936876:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857007.937012:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426915200 00000100:00100000:0.0:1787857007.937028:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426915200 00000100:00100000:0.0:1787857007.937134:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:0.0:1787857007.937146:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+15:15606:x1874703426915200:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1787857007.937185:0:20238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857007.937250:0:20238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5252 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a643c expref: -99 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.937467:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.937486:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.937521:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857007.937584:0:20238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787857007.937589:0:20238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787857007.937613:0:20238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.937625:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.937656:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5252 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 17 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.937678:0:20238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 16 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857007.937688:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857007.937691:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857007.937696:0:20238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb000, rc 0) 00000100:00100000:0.0:1787857007.937938:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+16:15606:x1874703426915200:12345-192.168.202.6@tcp:101:bash.0 Request processed in 793us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857007.937947:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:3.0:1787857007.941120:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857007.941354:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426915456 00000100:00100000:2.0:1787857007.941392:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426915456 00000100:00100000:2.0:1787857007.941470:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1787857007.941482:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+16:15606:x1874703426915456:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1787857007.941907:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+17:15606:x1874703426915456:12345-192.168.202.6@tcp:35:bash.0 Request processed in 425us (808us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787857007.941918:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:3.0:1787857008.012955:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.013124:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426915712 00000100:00100000:2.0:1787857008.013140:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426915712 00000100:00100000:2.0:1787857008.013284:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:2.0:1787857008.013300:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+17:15616:x1874703426915712:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787857008.013347:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857008.013385:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c5260 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6443 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857008.013542:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787857008.013716:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c5260 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6443 expref: 19 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.013738:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9064c7953500) 00010000:00010000:2.0:1787857008.013742:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857008.013766:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c5260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6443 expref: 19 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.013786:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b400, rc 0) 00000100:00100000:2.0:1787857008.013870:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+18:15616:x1874703426915712:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 573us (932us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787857008.013880:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000040:00080000:0.0:1787857008.018074:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787857008.020167:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.020330:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426915968 00000100:00100000:2.0:1787857008.020344:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426915968 00000100:00100000:2.0:1787857008.020413:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:2.0:1787857008.020425:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+18:15616:x1874703426915968:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1787857008.020746:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+19:15616:x1874703426915968:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 322us (595us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787857008.020763:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:0.0:1787857008.064662:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.064898:0:20315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426916224 00000100:00100000:2.0:1787857008.064913:0:20315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426916224 00000100:00100000:2.0:1787857008.064996:0:20315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:2.0:1787857008.065009:0:20315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+19:15619:x1874703426916224:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1787857008.065043:0:20315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857008.065071:0:20315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c526e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a644a expref: -99 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.065271:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c5275 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.065290:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c5275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.065306:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c5275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857008.065319:0:20315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787857008.065464:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c526e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a644a expref: 22 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.065490:0:20315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c5275 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a644a expref: 21 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.065518:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:2.0:1787857008.065521:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857008.065525:0:20315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b200, rc 0) 00000100:00100000:2.0:1787857008.065605:0:20315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+21:15619:x1874703426916224:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 598us (961us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787857008.065614:0:20315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:1.0:1787857008.071197:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.073431:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.074110:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426916352 00000100:00100000:0.0:1787857008.074127:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426916352 00000100:00100000:0.0:1787857008.074233:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:0.0:1787857008.074248:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+21:15619:x1874703426916352:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:0.0:1787857008.074526:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074547:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074562:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074612:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074620:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074628:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074635:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787857008.074640:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074649:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074663:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.074667:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857008.074673:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.074679:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c5283 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.074950:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+21:15619:x1874703426916352:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 704us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857008.074959:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:2.0:1787857008.076417:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426916480 00000100:00100000:2.0:1787857008.076437:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426916480 00000100:00100000:2.0:1787857008.076556:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1787857008.076570:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+21:2401:x1874703426916480:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857008.076592:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857008.076657:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b200/0xc25410d92a3c5275 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a644a expref: 21 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.076678:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:2.0:1787857008.076684:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857008.076774:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+20:2401:x1874703426916480:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 206us (3366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857008.076782:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1787857008.079335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.080088:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426916736 00000100:00100000:0.0:1787857008.080109:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426916736 00000100:00100000:0.0:1787857008.080177:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1787857008.080191:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+20:15619:x1874703426916736:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1787857008.080542:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+21:15619:x1874703426916736:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 352us (1227us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787857008.080551:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00010000:00010000:0.0:1787857008.339146:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857008.352540:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857008.352902:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426916992 00000100:00100000:1.0:1787857008.352917:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426916992 00000100:00100000:1.0:1787857008.353006:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:1.0:1787857008.353020:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7925a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+21:15650:x1874703426916992:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1787857008.353058:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857008.353171:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c528a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6451 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.353412:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5291 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.353435:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.353453:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857008.353469:0:17176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787857008.353682:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5ff800/0xc25410d92a3c528a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6451 expref: 24 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.353709:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5291 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6451 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.353721:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:1.0:1787857008.353744:0:17176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857008.353749:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065fd5fec00, rc 0) 00000100:00100000:1.0:1787857008.353839:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7925a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+23:15650:x1874703426916992:12345-192.168.202.6@tcp:101:cat.0 Request processed in 822us (1315us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787857008.353849:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1787857008.360518:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.361346:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426917120 00000100:00100000:2.0:1787857008.361363:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426917120 00000100:00100000:2.0:1787857008.361502:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:3.0:1787857008.361520:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.361521:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7926580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+23:2399:x1874703426917120:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857008.361544:0:17161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857008.361579:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065fd5fec00/0xc25410d92a3c5291 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6451 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.361684:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:2.0:1787857008.361701:0:17161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857008.361773:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426917376 00000100:00100000:2.0:1787857008.361780:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7926580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+22:2399:x1874703426917120:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 264us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857008.361780:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426917376 00000100:00100000:2.0:1787857008.361792:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1787857008.361914:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1787857008.361929:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+22:15650:x1874703426917376:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:1.0:1787857008.362390:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+23:15650:x1874703426917376:12345-192.168.202.6@tcp:35:cat.0 Request processed in 464us (872us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787857008.362399:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1787857008.437671:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.437990:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426917632 00000100:00100000:0.0:1787857008.438006:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426917632 00000100:00100000:0.0:1787857008.438127:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:0.0:1787857008.438144:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+23:15656:x1874703426917632:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1787857008.438197:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857008.438272:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c529f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6458 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.438450:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.438470:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 24 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.438508:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 24 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.438519:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.438564:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 24 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.438582:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 24 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.438598:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17175:1874703436440064:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787857008.438722:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 24 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.438733:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 24 pid: 20315 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.438742:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17175:1874703436440192:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787857008.438767:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857008.441741:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17175:1874703436440064:192.168.202.6@tcp:104: 00000100:00100000:0.0:1787857008.443194:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17175:1874703436440192:192.168.202.6@tcp:104: 00010000:00010000:0.0:1787857008.443277:0:17175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857008.445292:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.445351:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857008.445592:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426917760 00000100:00100000:1.0:1787857008.445605:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426917760 00010000:00010000:1.0:1787857008.445664:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 25 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857008.445705:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426917888 00000100:00100000:1.0:1787857008.445708:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426917888 00010000:00010000:1.0:1787857008.445722:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 26 pid: 20315 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857008.445739:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1787857008.445750:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+26:2402:x1874703426917760:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857008.445773:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857008.445781:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 26 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.445797:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 26 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.445841:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c5259 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a643c expref: 26 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.445861:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:1.0:1787857008.445867:0:17160:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.445877:0:17160:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.445884:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857008.445969:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+25:2402:x1874703426917760:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 219us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857008.445978:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1787857008.446002:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1787857008.446011:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600688c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+24:2402:x1874703426917888:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857008.446020:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857008.446024:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 24 pid: 20315 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.446033:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 24 pid: 20315 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.446045:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c5244 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6435 expref: 24 pid: 20315 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.446067:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:1.0:1787857008.446071:0:17160:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.446080:0:17160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.446089:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.446134:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857008.446157:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600688c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+23:2402:x1874703426917888:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 148us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857008.446164:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00010000:00010000:0.0:1787857008.446715:0:17175:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.446727:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857008.446753:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787857008.446960:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c529f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6458 expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.446979:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007baa00/0xc25410d92a3c52a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6458 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.446987:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.446990:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787857008.446992:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007baa00, rc 0) 00000100:00100000:0.0:1787857008.447036:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+23:15656:x1874703426917632:12345-192.168.202.6@tcp:101:dd.0 Request processed in 8898us (9383us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787857008.447044:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:2.0:1787857008.454527:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.457643:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426918016 00000100:00100000:0.0:1787857008.457664:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426918016 00000100:00100000:0.0:1787857008.457999:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:0.0:1787857008.458012:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+23:15656:x1874703426918016:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1787857008.458174:0:20238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857008.458212:0:20238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c52b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a645f expref: -99 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.458316:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.458335:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.458349:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.458503:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb200/0xc25410d92a3c52b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 25 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.458528:0:20238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 24 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.458539:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.458542:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857008.458547:0:20238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9066007bb000, rc 0) 00000100:00100000:0.0:1787857008.458976:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+24:15656:x1874703426918016:12345-192.168.202.6@tcp:101:dd.0 Request processed in 965us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857008.458988:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1787857008.462379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.462486:0:20315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426918272 00000100:00100000:0.0:1787857008.462501:0:20315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426918272 00000100:00100000:0.0:1787857008.462578:0:20315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:0.0:1787857008.462590:0:20315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+24:15656:x1874703426918272:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:0.0:1787857008.462908:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.462950:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.462964:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857008.463019:0:20315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787857008.463048:0:20315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038c992b6 reply state 00000000e79aba41 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.463062:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.463070:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.463073:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787857008.463077:0:20315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857008.463249:0:20315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+27:15656:x1874703426918272:12345-192.168.202.6@tcp:36:dd.0 Request processed in 660us (884us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787857008.463257:0:20315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000020:00080000:0.0:1787857008.463263:0:20315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787857008.467550:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.467661:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426918400 00000100:00100000:0.0:1787857008.467675:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426918400 00000100:00100000:0.0:1787857008.467846:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:0.0:1787857008.467859:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+27:15656:x1874703426918400:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1787857008.467895:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857008.467925:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c52c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6466 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.468007:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c52c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6466 expref: 28 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.468049:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c52c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6466 expref: 28 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.468103:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.468107:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857008.468119:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c0030600, rc 0) 00000100:00100000:0.0:1787857008.468201:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+28:15656:x1874703426918400:12345-192.168.202.6@tcp:101:dd.0 Request processed in 346us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857008.468210:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:1.0:1787857008.481995:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.482137:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426918656 00000100:00100000:3.0:1787857008.482169:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426918656 00000100:00100000:3.0:1787857008.482311:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:3.0:1787857008.482335:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+28:15656:x1874703426918656:12345-192.168.202.6@tcp:103:dd.0 00010000:00010000:3.0:1787857008.482359:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857008.482398:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c52c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6466 expref: 28 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.482428:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:3.0:1787857008.482436:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857008.482520:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+27:15656:x1874703426918656:12345-192.168.202.6@tcp:103:dd.0 Request processed in 199us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857008.482531:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1787857008.485486:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.485610:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426918784 00000100:00100000:0.0:1787857008.485622:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426918784 00000100:00100000:0.0:1787857008.485738:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:0.0:1787857008.485763:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+27:15656:x1874703426918784:12345-192.168.202.6@tcp:58:dd.0 00010000:00010000:0.0:1787857008.485923:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.485947:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.485962:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857008.487811:0:20238:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787857008.488177:0:20238:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787857008.488585:0:20238:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787857008.488969:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+27:15656:x1874703426918784:12345-192.168.202.6@tcp:58:dd.0 Request processed in 3211us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857008.488983:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:1.0:1787857008.494943:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.495021:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426918912 00000100:00100000:3.0:1787857008.495034:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426918912 00000100:00100000:3.0:1787857008.495300:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1787857008.495323:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+27:15656:x1874703426918912:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1787857008.495355:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857008.495386:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a646d expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.495467:0:17172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.495481:0:17172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a646d expref: 28 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.495509:0:17172:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.495550:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a646d expref: 28 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.495567:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:3.0:1787857008.495571:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857008.495575:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a646d expref: 28 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.495584:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274a800, rc 0) 00000100:00100000:3.0:1787857008.495667:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+28:15656:x1874703426918912:12345-192.168.202.6@tcp:101:dd.0 Request processed in 358us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857008.495676:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000040:00080000:0.0:1787857008.785706:0:17209:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787857008.785722:0:17209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857008.785787:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787857008.785801:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787857008.786048:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c80cda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17209:1874703436440320:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857008.786444:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065fd4eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857008.796065:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.796252:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426919040 00000100:00100000:2.0:1787857008.796265:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426919040 00000100:00100000:2.0:1787857008.796357:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:2.0:1787857008.796370:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c83612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+29:15657:x1874703426919040:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857008.796418:0:17175:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857008.796641:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c83612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+29:15657:x1874703426919040:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 272us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857008.796650:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:1.0:1787857008.800513:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.800647:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426919168 00000100:00100000:3.0:1787857008.800659:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426919168 00000100:00100000:3.0:1787857008.800729:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:3.0:1787857008.800738:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+29:15657:x1874703426919168:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857008.800836:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.800858:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.800871:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801041:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801086:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801113:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801149:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801158:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801165:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.801177:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c80cda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17209:1874703436440320:192.168.202.6@tcp:107:hsm_cdtr.0 00000004:00200000:3.0:1787857008.801411:0:20238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787857008.801418:0:20238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787857008.801438:0:20238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801451:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801459:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801467:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801474:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274a400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787857008.801478:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801494:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801510:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9064c73f6700) 00010000:00010000:3.0:1787857008.801514:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857008.801520:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801526:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c52de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801543:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801549:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801555:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801560:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274ae00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787857008.801562:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801568:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801575:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9065c5167d00) 00010000:00010000:3.0:1787857008.801578:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857008.801581:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801597:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c52e5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801614:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801620:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801626:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801631:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274b400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787857008.801634:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801640:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801648:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:3.0:1787857008.801650:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857008.801653:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.801659:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c52ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857008.801772:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+28:15657:x1874703426919168:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 1030us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857008.801792:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:1.0:1787857008.805364:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.805440:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426919424 00000100:00100000:3.0:1787857008.805449:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426919424 00000100:00100000:3.0:1787857008.805510:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:3.0:1787857008.805519:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+28:15657:x1874703426919424:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857008.805548:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857008.805569:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c52f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6474 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805672:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805688:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805698:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857008.805709:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787857008.805801:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805808:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805814:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805820:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787857008.805824:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805839:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805866:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:3.0:1787857008.805870:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857008.805874:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805881:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c52fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805920:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c52f3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6474 expref: 30 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805930:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9064c73f6700) 00010000:00010000:3.0:1787857008.805933:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857008.805936:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c52f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6474 expref: 30 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.805945:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274be00, rc 0) 00000100:00100000:3.0:1787857008.806004:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+29:15657:x1874703426919424:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 486us (648us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787857008.806012:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:0.0:1787857008.819633:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.819769:0:20315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426919552 00000100:00100000:3.0:1787857008.819998:0:20315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426919552 00000100:00100000:3.0:1787857008.820130:0:20315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:3.0:1787857008.820142:0:20315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+29:15657:x1874703426919552:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857008.820180:0:20315:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857008.820368:0:20315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+29:15657:x1874703426919552:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 228us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857008.820408:0:20315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:0.0:1787857008.843141:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.844055:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426919808 00000100:00100000:3.0:1787857008.844065:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426919808 00000100:00100000:3.0:1787857008.844372:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1787857008.844387:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+29:15657:x1874703426919808:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857008.844417:0:20238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857008.844443:0:20238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c5308 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a647b expref: -99 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857008.844904:0:20238:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1787857008.844912:0:20238:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1787857008.844934:0:20238:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787857008.845079:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c530f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.845108:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c530f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.845120:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c530f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.845178:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c5308 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a647b expref: 32 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.845199:0:20238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c530f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a647b expref: 31 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.845209:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:3.0:1787857008.845282:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857008.845287:0:20238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274b600, rc 0) 00000100:00100000:3.0:1787857008.845367:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+31:15657:x1874703426919808:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 984us (2239us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787857008.845375:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:1.0:1787857008.852607:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.853253:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426920064 00000100:00100000:2.0:1787857008.853263:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426920064 00000100:00100000:2.0:1787857008.853335:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:2.0:1787857008.853345:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+31:15657:x1874703426920064:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857008.853416:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857008.853443:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b600/0xc25410d92a3c530f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a647b expref: 31 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853470:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167d00) 00010000:00010000:2.0:1787857008.853496:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857008.853521:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853549:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853560:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853575:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853582:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853587:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853630:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853638:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853645:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853651:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b400 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857008.853655:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853663:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853679:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:2.0:1787857008.853682:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857008.853687:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853692:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b400/0xc25410d92a3c531d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853702:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853707:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853712:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853717:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857008.853720:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853725:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853732:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa8fc173a (ffff9064c73f6200) 00010000:00010000:2.0:1787857008.853734:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857008.853737:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.853743:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5324 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa8fc173a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857008.853837:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906601a3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+30:15657:x1874703426920064:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 492us (1239us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857008.853844:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:1.0:1787857008.865618:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.865800:0:20315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426920192 00000100:00100000:3.0:1787857008.865811:0:20315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426920192 00000100:00100000:3.0:1787857008.865871:0:20315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:3.0:1787857008.865881:0:20315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+30:15657:x1874703426920192:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857008.865900:0:20315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857008.865923:0:20315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c532b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6482 expref: -99 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.865960:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c5332 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.865974:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c5332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.865986:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c5332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.866118:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c532b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6482 expref: 32 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.866139:0:20315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274b400/0xc25410d92a3c5332 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6482 expref: 31 pid: 20315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.866149:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:3.0:1787857008.866161:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857008.866165:0:20315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274b400, rc 0) 00000100:00100000:3.0:1787857008.866259:0:20315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+31:15657:x1874703426920192:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 379us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857008.866267:0:20315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:0.0:1787857008.870799:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.870883:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426920448 00000100:00100000:3.0:1787857008.870894:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426920448 00000100:00100000:3.0:1787857008.870960:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:3.0:1787857008.870970:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+31:15657:x1874703426920448:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857008.871058:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.871208:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.871252:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857008.871429:0:20238:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787857008.871439:0:20238:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 542581221633ns, next at 543581218963ns, rc = 0 00000004:00010000:3.0:1787857008.871489:0:20238:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d8aeaf0 reply state 0000000072d5bf75 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.871502:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.871510:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:3.0:1787857008.871513:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787857008.871518:0:20238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857008.871771:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+33:15657:x1874703426920448:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 801us (982us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787857008.871795:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:3.0:1787857008.874015:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.874127:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426920576 00000100:00100000:2.0:1787857008.874138:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426920576 00000100:00100000:2.0:1787857008.874194:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:2.0:1787857008.874205:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7925680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+33:15657:x1874703426920576:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857008.874267:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857008.874288:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6489 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.874355:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 34 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.874372:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 34 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.874391:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:2.0:1787857008.874395:0:17176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857008.874399:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b600, rc 0) 00000100:00100000:2.0:1787857008.874457:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7925680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+34:15657:x1874703426920576:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 254us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857008.874465:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1787857008.878855:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.878960:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426920704 00000100:00100000:0.0:1787857008.878970:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426920704 00000100:00100000:0.0:1787857008.879028:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1787857008.879038:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2401:x1874703426920704:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787857008.879341:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2401:x1874703426920704:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 303us (495us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787857008.879350:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1787857008.884963:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.885059:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426920960 00000100:00100000:2.0:1787857008.885067:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426920960 00000100:00100000:2.0:1787857008.885139:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:2.0:1787857008.885162:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+34:15657:x1874703426920960:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857008.885416:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+35:15657:x1874703426920960:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 255us (466us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787857008.885423:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1787857008.890327:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.890727:0:20315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426921216 00000100:00100000:2.0:1787857008.890736:0:20315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426921216 00000100:00100000:2.0:1787857008.890798:0:20315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1787857008.890807:0:20315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+35:15657:x1874703426921216:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857008.890937:0:20315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+35:15657:x1874703426921216:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 131us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857008.890946:0:20315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:0.0:1787857008.895037:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.895590:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426921344 00000100:00100000:3.0:1787857008.895601:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426921344 00000100:00100000:3.0:1787857008.895668:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:3.0:1787857008.895679:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+35:15657:x1874703426921344:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857008.895699:0:20238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857008.895719:0:20238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c5347 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6490 expref: -99 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.895795:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c534e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.895809:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c534e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.895819:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c534e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857008.895861:0:20238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787857008.895878:0:20238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c534e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.895903:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274be00/0xc25410d92a3c5347 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6490 expref: 37 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.895921:0:20238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c534e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6490 expref: 36 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.895947:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:3.0:1787857008.895950:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787857008.895954:0:20238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274a400, rc 0) 00000100:00100000:3.0:1787857008.896024:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+36:15657:x1874703426921344:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 347us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857008.896031:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:1.0:1787857008.901985:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.909274:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426921472 00000100:00100000:2.0:1787857008.909291:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426921472 00000100:00100000:2.0:1787857008.909386:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:2.0:1787857008.909397:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+6:2402:x1874703426921472:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857008.909418:0:18680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857008.909444:0:18680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a6497 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857008.909471:0:18680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908870, blocks: 0x0 00010000:00010000:2.0:1787857008.909493:0:18680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1787857008.909498:0:18680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857008.909508:0:18680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 7 pid: 18680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.909549:0:18680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 7 pid: 18680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.909563:0:18680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90660076b400, rc 0) 00000100:00100000:2.0:1787857008.909633:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+7:2402:x1874703426921472:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 238us (7669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857008.909641:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:0.0:1787857008.913107:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.913196:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426921728 00000100:00100000:3.0:1787857008.913207:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426921728 00000100:00100000:3.0:1787857008.913305:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1787857008.913326:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+36:15657:x1874703426921728:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857008.913452:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+36:15657:x1874703426921728:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 129us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857008.913460:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1787857008.922538:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.922648:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426921856 00000100:00100000:2.0:1787857008.922659:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426921856 00000100:00100000:2.0:1787857008.922731:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1787857008.922741:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+36:15657:x1874703426921856:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787857008.925695:0:17154:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787857008.925713:0:17154:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787857008.925866:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925879:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925887:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925893:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076ba00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857008.925898:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925907:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925944:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9064c73f6900) 00010000:00010000:2.0:1787857008.925948:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857008.925954:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925960:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c518e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925984:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925990:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.925996:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926000:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076aa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857008.926003:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926008:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926014:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:2.0:1787857008.926016:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857008.926019:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926024:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5195 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926050:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926056:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926061:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926066:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007bbc00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857008.926069:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926075:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926083:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9064c7953c00) 00010000:00010000:2.0:1787857008.926085:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857008.926087:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926102:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bbc00/0xc25410d92a3c523d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926117:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926123:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926128:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926143:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9066007ba000 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857008.926146:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926151:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926159:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:2.0:1787857008.926162:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857008.926165:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926170:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007ba000/0xc25410d92a3c52c2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926182:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926187:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926192:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926196:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274ae00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:2.0:1787857008.926198:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926204:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926281:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:2.0:1787857008.926284:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787857008.926288:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.926294:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ae00/0xc25410d92a3c5339 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857008.927106:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436440448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787857008.927174:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857008.927293:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436440448 00000100:00100000:2.0:1787857008.927299:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436440448 00000100:00100000:2.0:1787857008.927364:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787857008.927375:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436440448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787857008.927502:0:18998:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787857008.927506:0:18998:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787857008.927509:0:18998:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787857008.927511:0:18998:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787857008 -> 1787857008 00002000:00010000:2.0:1787857008.927513:0:18998:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000001:00080000:0.0:1787857008.927973:0:17154:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1787857008.928149:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.928159:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.928167:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.928173:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274ba00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:3.0:1787857008.928177:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.928184:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.928209:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9064c73f6500) 00010000:00010000:3.0:1787857008.928212:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787857008.928237:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.928244:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274ba00/0xc25410d92a3c51e2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857008.928467:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c6b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1874703436440448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1093us (1291us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787857008.928478:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787857008.928503:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857008.928604:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+15:15657:x1874703426921856:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 5863us (6073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857008.928613:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1787857008.931565:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.931640:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426921984 00000100:00100000:2.0:1787857008.931651:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426921984 00000100:00100000:2.0:1787857008.931710:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:2.0:1787857008.931721:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7926d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+7:2402:x1874703426921984:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787857008.931865:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7926d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+7:2402:x1874703426921984:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 146us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857008.931873:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1787857008.935104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000004:00080000:1.0:1787857008.935239:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9064c7927c00/2, rc 0, transno 8589934596 00000100:00100000:1.0:1787857008.935251:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7927c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436440448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787857008.935527:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426922240 00000100:00100000:2.0:1787857008.935533:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426922240 00000100:00100000:0.0:1787857008.935668:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1787857008.935678:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+15:15657:x1874703426922240:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857008.935737:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857008.935770:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a400/0xc25410d92a3c534e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6490 expref: 15 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.935785:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:0.0:1787857008.935790:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857008.935820:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c535c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.935834:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c535c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.935845:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c535c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857008.935957:0:17176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d230e35e reply state 00000000f47f3bc9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c535c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.935966:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030200/0xc25410d92a3c535c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.935970:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:0.0:1787857008.935972:0:17176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787857008.935974:0:17176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857008.936056:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+16:15657:x1874703426922240:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 378us (968us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787857008.936063:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1787857008.938486:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.938531:0:20239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426922368 00000100:00100000:3.0:1787857008.938540:0:20239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426922368 00000100:00100000:3.0:1787857008.938616:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:3.0:1787857008.938627:0:20239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+7:15657:x1874703426922368:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857008.938645:0:20239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857008.938662:0:20239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a649e expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.938693:0:20239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 8 pid: 18680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.938700:0:20239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857008.938704:0:20239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857008.938707:0:20239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 8 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.938734:0:20239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 8 pid: 18680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.938769:0:20239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 8 pid: 18680 timeout: 642 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857008.938782:0:20239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c79243c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20239:1874703436440576:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787857008.938910:0:20239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d174acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857008.942401:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.942556:0:20239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c79243c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20239:1874703436440576:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787857008.942592:0:20239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 8 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.942614:0:20239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065d274be00, rc 0) 00000100:00100000:2.0:1787857008.942676:0:20239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+8:15657:x1874703426922368:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 4051us (4196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857008.942686:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:0.0:1787857008.943495:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426922496 00000100:00100000:0.0:1787857008.943505:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426922496 00010000:00010000:0.0:1787857008.943557:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 8 pid: 18680 timeout: 642 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.943593:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1787857008.943602:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+8:2401:x1874703426922496:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857008.943616:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857008.943638:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 8 pid: 18680 timeout: 642 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.943650:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 8 pid: 18680 timeout: 642 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.943673:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009523a763/0xc25410d92a3c5355 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6497 expref: 8 pid: 18680 timeout: 642 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.943687:0:17159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857008.943691:0:17159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857008.943697:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 7 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.943707:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 7 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.943742:0:17159:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 7 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.943783:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70eda40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17159:1874703436440704:192.168.202.6@tcp:105: 00000100:00100000:0.0:1787857008.943857:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065eb5fd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787857008.946988:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70eda40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17159:1874703436440704:192.168.202.6@tcp:105: 00010000:00010000:0.0:1787857008.947016:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857008.947074:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+7:2401:x1874703426922496:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 3472us (4683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857008.947085:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:3.0:1787857008.948944:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.949022:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426922624 00000100:00100000:2.0:1787857008.949028:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426922624 00000100:00100000:2.0:1787857008.949074:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:2.0:1787857008.949084:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+7:2402:x1874703426922624:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787857008.949254:0:18682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787857008.949257:0:18682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787857008 00002000:00010000:2.0:1787857008.949259:0:18682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787857007 00002000:00010000:2.0:1787857008.949260:0:18682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787857008 -> 1787857008 00002000:00010000:2.0:1787857008.949262:0:18682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787857008.949306:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+8:2402:x1874703426922624:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 224us (368us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787857008.949316:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:1.0:1787857008.951346:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1787857008.951424:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426922752 00000100:00100000:3.0:1787857008.951430:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426922752 00000100:00100000:3.0:1787857008.951469:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:3.0:1787857008.951475:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+8:2401:x1874703426922752:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857008.951505:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.951520:0:18680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 8 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.951526:0:18680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857008.951529:0:18680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857008.951533:0:18680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.951556:0:18680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 8 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857008.951580:0:18680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 8 pid: 20239 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857008.951591:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18680:1874703436440832:192.168.202.6@tcp:104: 00000100:00100000:3.0:1787857008.951659:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065d174a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857008.954142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.954283:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7924000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18680:1874703436440832:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787857008.954307:0:18680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857008.954422:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426922880 00000100:00100000:1.0:1787857008.954429:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426922880 00010000:00010000:1.0:1787857008.954465:0:17160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 9 pid: 20239 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857008.954497:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:1.0:1787857008.954504:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c79261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+9:2401:x1874703426922880:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857008.954520:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857008.954541:0:17160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 9 pid: 20239 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.954549:0:17160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 9 pid: 20239 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.954570:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a52843ce/0xc25410d92a3c5363 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a649e expref: 9 pid: 20239 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.954583:0:17160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857008.954586:0:17160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857008.954590:0:17160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.954597:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.954646:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857008.954692:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c79261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+8:2401:x1874703426922880:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 188us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857008.954699:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00010000:00010000:0.0:1787857008.954853:0:18680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.954862:0:18680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.954883:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.954891:0:18680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.954899:0:18680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.954906:0:18680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065d274ac00 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787857008.954910:0:18680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.954927:0:18680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.954940:0:18680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.954948:0:18680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef4258f7/0xc25410d92a3c536a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.955002:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+7:2401:x1874703426922752:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 3525us (3660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857008.955010:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:3.0:1787857008.957294:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857008.957416:0:20315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426923136 00000100:00100000:2.0:1787857008.957426:0:20315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426923136 00000100:00100000:2.0:1787857008.957480:0:20315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1787857008.957490:0:20315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+16:15657:x1874703426923136:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857008.957565:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.957580:0:20315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 16 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.957589:0:20315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.957631:0:20315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 16 pid: 20238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.957644:0:20315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 16 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857008.957659:0:20315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20315:1874703436440960:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787857008.957733:0:20315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857008.962492:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857008.962589:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426923264 00000100:00100000:0.0:1787857008.962599:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426923264 00010000:00010000:0.0:1787857008.962641:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 17 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.962684:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1787857008.962694:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+17:2401:x1874703426923264:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857008.962709:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857008.962716:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 17 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.962729:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 17 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.962838:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.962845:0:17159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a646d expref: 17 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.962856:0:17159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.962864:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.962872:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.962893:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857008.962956:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+17:2401:x1874703426923264:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 263us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857008.962964:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00010000:00010000:2.0:1787857008.963085:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9066007bb000/0xc25410d92a3c52bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a645f expref: 16 pid: 20238 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857008.963122:0:20315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20315:1874703436440960:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787857008.963141:0:20315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.963150:0:20315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.963156:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.963591:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.963604:0:20315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 16 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.963613:0:20315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.963641:0:20315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 16 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.963655:0:20315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 16 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857008.963668:0:20315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20315:1874703436441088:192.168.202.6@tcp:104: 00000100:00100000:2.0:1787857008.963738:0:20315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857008.970739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857008.974758:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426923392 00000100:00100000:1.0:1787857008.974774:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426923392 00010000:00010000:1.0:1787857008.974825:0:17161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 17 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857008.974874:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:1.0:1787857008.974885:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+17:2401:x1874703426923392:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857008.974901:0:17161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857008.974908:0:17161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 17 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.974923:0:17161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 17 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.974948:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:1.0:1787857008.974953:0:17161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.974962:0:17161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.974970:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857008.975005:0:17161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857008.975070:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54732495-c2d9-4110-96c9-7cc6d03017e0+17:2401:x1874703426923392:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 186us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857008.975078:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00010000:00010000:2.0:1787857008.978156:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5340 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a6489 expref: 16 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857008.978183:0:20315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20315:1874703436441088:192.168.202.6@tcp:104: 00010000:00010000:2.0:1787857008.978207:0:20315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.978240:0:20315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857008.978247:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857008.978365:0:20315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787857008.978473:0:20315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787857008.978510:0:20315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787857008.978606:0:20315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008dad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20315:1874703436441216:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787857008.978677:0:20315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857008.978720:0:20315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9065c754e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857008.978869:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436441216 00000100:00100000:3.0:1787857008.978875:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436441216 00000100:00100000:3.0:1787857008.978925:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787857008.978934:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20315:x1874703436441216:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787857008.979030:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20315:x1874703436441216:12345-0@lo:1000:mdt00_004.0 Request processed in 97us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857008.979038:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787857008.979128:0:20315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008dad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20315:1874703436441216:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787857008.979304:0:20315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787857008.979348:0:20315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20315:1874703436441344:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787857008.979380:0:20315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857008.979409:0:20315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b379c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857008.979480:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436441344 00000100:00100000:1.0:1787857008.979486:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436441344 00000100:00100000:1.0:1787857008.979523:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787857008.979531:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20315:x1874703436441344:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787857008.979651:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20315:x1874703436441344:12345-0@lo:1000:mdt00_004.0 Request processed in 121us (270us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787857008.979660:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787857008.979739:0:20315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70eda40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20315:1874703436441344:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787857008.979783:0:20315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979792:0:20315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979810:0:20315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979817:0:20315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076ba00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787857008.979821:0:20315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979830:0:20315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979845:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:0.0:1787857008.979849:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857008.979853:0:20315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979860:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076ba00/0xc25410d92a3c5378 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979891:0:20315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979899:0:20315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979904:0:20315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979910:0:20315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c0030800 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787857008.979912:0:20315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979931:0:20315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979940:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.979943:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857008.979949:0:20315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a646d expref: 19 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979960:0:20315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a646d expref: 19 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.979970:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a646d expref: 19 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.980022:0:20315:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9065d274a800/0xc25410d92a3c52d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a646d expref: 19 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857008.980034:0:20315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20315:1874703436441472:192.168.202.6@tcp:105: 00000100:00100000:0.0:1787857008.980114:0:20315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9064c6b37c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857008.982739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857008.982845:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426923520 00000100:00100000:1.0:1787857008.982855:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426923520 00000100:00100000:1.0:1787857008.982912:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1787857008.982924:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906600459850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+20:15656:x1874703426923520:12345-192.168.202.6@tcp:49:dd.0 00000100:00100000:1.0:1787857008.983055:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906600459850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+20:15656:x1874703426923520:12345-192.168.202.6@tcp:49:dd.0 Request processed in 134us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857008.983063:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1787857008.983303:0:20315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20315:1874703436441472:192.168.202.6@tcp:105: 00010000:00010000:0.0:1787857008.983327:0:20315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983336:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c52d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983370:0:20315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983399:0:20315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983411:0:20315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983422:0:20315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983430:0:20315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983436:0:20315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983442:0:20315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c0030600 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787857008.983446:0:20315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983453:0:20315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983464:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.983468:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857008.983472:0:20315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983478:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c537f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983488:0:20315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983501:0:20315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983507:0:20315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983512:0:20315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076aa00 already unused, calling callback (ffffffffc1a254f0) 00010000:00010000:0.0:1787857008.983515:0:20315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983521:0:20315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983530:0:20315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857008.983533:0:20315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857008.983535:0:20315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857008.983541:0:20315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076aa00/0xc25410d92a3c5371 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20315 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857008.983735:0:17209:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787857008.983741:0:17209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857008.983756:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787857008.983763:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787857008.983833:0:20315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54732495-c2d9-4110-96c9-7cc6d03017e0+19:15657:x1874703426923136:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 26343us (26545us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787857008.983842:0:20315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000020:00080000:0.0:1787857008.983846:0:20315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787857009.006603:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1787857009.006684:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426923648 00000100:00100000:0.0:1787857009.006708:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426923648 00000100:00100000:0.0:1787857009.006783:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:0.0:1787857009.006794:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+19:15656:x1874703426923648:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1787857009.006816:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857009.006836:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c5386 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf523a3ac673a64a5 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.006870:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c538d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.006885:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c538d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.006897:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c538d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.007012:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030600/0xc25410d92a3c5386 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a64a5 expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.007032:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9065c0030800/0xc25410d92a3c538d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf523a3ac673a64a5 expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.007041:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9064c7953400) 00010000:00010000:0.0:1787857009.007044:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857009.007047:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9065c0030800, rc 0) 00000100:00080000:2.0:1787857009.007198:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857009.007316:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+20:15656:x1874703426923648:12345-192.168.202.6@tcp:101:dd.0 Request processed in 516us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857009.007325:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:1.0:1787857009.019680:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857009.020448:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426923904 00000100:00100000:2.0:1787857009.020461:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426923904 00000100:00100000:2.0:1787857009.029390:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1787857009.029427:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+20:15657:x1874703426923904:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787857009.029757:0:17177:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787857009.029796:0:17177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787857009.029829:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.029867:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.029879:0:17177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.029887:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.029893:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.029900:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.029921:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857009.030022:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+22:15657:x1874703426923904:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 613us (10351us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787857009.030029:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000020:00080000:2.0:1787857009.030035:0:17177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857009.030613:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857009.030628:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.030636:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076b600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787857009.030640:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.030648:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.030662:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9065c5167800) 00010000:00010000:0.0:1787857009.030665:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857009.030670:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.030675:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90660076b600/0xc25410d92a3c5394 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.030687:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857009.030689:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857009.030691:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857009.238175:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1787857009.238867:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426924160 00000100:00100000:2.0:1787857009.238882:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426924160 00000100:00100000:2.0:1787857009.239004:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1787857009.239016:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+7:2402:x1874703426924160:12345-192.168.202.6@tcp:4:dd.0 00002000:00010000:2.0:1787857009.239073:0:18686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a908870, atime: 0x6a90886f, ctime: 0x6a908870, blocks: 0x0 00010000:00010000:2.0:1787857009.239084:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.239109:0:18686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1787857009.239128:0:18686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857009.239136:0:18686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.239162:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787857009.240353:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857009.240455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857009.241873:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787857009.241887:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787857009.242007:0:18688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787857009.242025:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426924032 00000100:00100000:0.0:1787857009.242034:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426924032 00000100:00100000:0.0:1787857009.253634:0:20317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1787857009.253656:0:20317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c7924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+8:2402:x1874703426924032:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:0.0:1787857009.253701:0:20317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.253719:0:20317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857009.254418:0:20317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857009.254427:0:20317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.254444:0:20317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857009.361447:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857009.362942:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1787857009.362971:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1787857009.363993:0:18686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1787857009.364001:0:18686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787857008 -> 1787857009 00002000:00010000:0.0:1787857009.364005:0:18686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787857008 -> 1787857009 00002000:00010000:0.0:1787857009.364007:0:18686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1787857009.364029:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.364045:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.364056:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.364064:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90660076a200 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:0.0:1787857009.364070:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.364095:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.364122:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857009.364149:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7f65fc1/0xc25410d92a3c539b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857009.364383:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+7:2402:x1874703426924160:12345-192.168.202.6@tcp:4:dd.0 Request processed in 125363us (126210us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787857009.364397:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000001:00080000:3.0:1787857009.393270:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787857009.393616:0:20317:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1787857009.393641:0:20317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.393658:0:20317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.393669:0:20317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.393678:0:20317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9065c0030600 already unused, calling callback (ffffffffc0e1c440) 00010000:00010000:2.0:1787857009.393683:0:20317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.393693:0:20317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.393718:0:20317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857009.393727:0:20317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f138d27d/0xc25410d92a3c53a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857009.393952:0:20317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c7924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2402:x1874703426924032:12345-192.168.202.6@tcp:4:dd.0 Request processed in 140296us (155677us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787857009.393966:0:20317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1787857009.491352:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436441600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857009.491486:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857009.491657:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436441600 00000100:00100000:0.0:1787857009.491670:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436441600 00000100:00100000:0.0:1787857009.491755:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787857009.491768:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436441600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857009.491811:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787857009.491877:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c826cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436441600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857009.491886:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787857009.491968:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857009.492032:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c70efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436441600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857010.001473:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c79243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436441728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787857010.001599:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857010.001607:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436441984:0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.001659:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857010.001663:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436442240:0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.001686:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c7926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436441856:0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.001700:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436442496:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.001708:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857010.001736:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857010.001740:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436442752:0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.001747:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857010.001774:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436442368:0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.001779:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436443008:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.001783:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857010.001807:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857010.001818:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436443264:0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.001824:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857010.001829:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436442880:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.001865:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857010.001865:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787857010.001876:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436442112:0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.001887:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436441984 00000100:00100000:3.0:1787857010.001895:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436441984 00000100:00100000:2.0:1787857010.001916:0:20239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436442496 00000100:00100000:2.0:1787857010.001922:0:20239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436442496 00000100:00100000:0.0:1787857010.001926:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857010.001942:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436442368 00000100:00100000:3.0:1787857010.001945:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436442368 00000100:00100000:3.0:1787857010.001960:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787857010.001965:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436442624:0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.001970:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436441984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.001995:0:20239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436442112 00000100:00100000:2.0:1787857010.002000:0:20239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436442112 00000100:00100000:0.0:1787857010.002005:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857010.002032:0:20239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436442624 00000100:00100000:0.0:1787857010.002032:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436443136:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.002038:0:20239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436442624 00000100:00100000:3.0:1787857010.002050:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436441984:12345-0@lo:400:kworker.0 Request processed in 79us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857010.002057:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787857010.002066:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857010.002076:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787857010.002096:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787857010.002101:0:20239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436442496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002111:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8cb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436442368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.002129:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436441984:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.002152:0:20239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436442496:12345-0@lo:400:kworker.0 Request processed in 54us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857010.002159:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8cb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874703436442368:12345-0@lo:400:kworker.0 Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857010.002165:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787857010.002166:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436442496:0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002170:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787857010.002190:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787857010.002200:0:20239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436442112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002202:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436442240 00000100:00100000:3.0:1787857010.002206:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436442240 00000100:00100000:0.0:1787857010.002246:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436442752 00000100:00100000:0.0:1787857010.002252:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436442752 00000100:00100000:3.0:1787857010.002262:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436443008 00000100:00100000:3.0:1787857010.002266:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436443008 00000100:00100000:2.0:1787857010.002280:0:20239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1874703436442112:12345-0@lo:400:kworker.0 Request processed in 81us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857010.002283:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436443264 00000100:00100000:3.0:1787857010.002286:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436443136 00000100:00100000:0.0:1787857010.002289:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436443264 00000100:00100000:3.0:1787857010.002290:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436443136 00000100:00100000:2.0:1787857010.002293:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787857010.002309:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787857010.002317:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787857010.002322:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436442240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.002328:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787857010.002330:0:20239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436442624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.002343:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436442752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002362:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874703436442240:12345-0@lo:400:kworker.0 Request processed in 46us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857010.002368:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787857010.002377:0:20239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1874703436442624:12345-0@lo:400:kworker.0 Request processed in 49us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857010.002384:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787857010.002388:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787857010.002394:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c70ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436443008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857010.002394:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874703436442752:12345-0@lo:400:kworker.0 Request processed in 54us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857010.002409:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787857010.002422:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787857010.002433:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787857010.002435:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436443136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002439:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c70ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874703436443008:12345-0@lo:400:kworker.0 Request processed in 46us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857010.002447:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436443264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002451:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787857010.002492:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874703436442240:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.002494:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874703436443136:12345-0@lo:400:kworker.0 Request processed in 62us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857010.002504:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787857010.002509:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874703436442752:0@lo:400:kworker.0 00000100:00080000:2.0:1787857010.002545:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857010.002552:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787857010.002555:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857010.002559:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857010.002564:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857010.002595:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874703436442368:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.002599:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436441728 00000100:00100000:2.0:1787857010.002605:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436441728 00000100:00100000:3.0:1787857010.002615:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436442880 00000100:00100000:3.0:1787857010.002620:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436442880 00000100:00100000:2.0:1787857010.002639:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787857010.002647:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787857010.002652:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436441728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787857010.002659:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8cb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436442880:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787857010.002674:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1787857010.002686:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8cb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874703436442880:12345-0@lo:400:kworker.0 Request processed in 31us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857010.002691:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787857010.002707:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874703436442880:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.002729:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436441728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (1130us total) trans 0 rc 0/0 00000100:00080000:3.0:1787857010.002731:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857010.002740:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787857010.002762:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c79243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436441728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787857010.002788:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1787857010.002793:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9064c7927c00, transno 8589934596 00000004:00080000:3.0:1787857010.002803:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1787857010.002820:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874703436442112:0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002826:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874703436442624:0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002832:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874703436443136:0@lo:400:kworker.0 00010000:00080000:3.0:1787857010.002849:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8cb0b40 x1874703436443008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857010.002858:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874703436443008:0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002891:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436441856 00000100:00100000:3.0:1787857010.002893:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436441856 00000100:00100000:3.0:1787857010.002915:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787857010.002919:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3624:x1874703436441856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.002947:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681+24:3624:x1874703436441856:12345-0@lo:400:kworker.0 Request processed in 28us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857010.002952:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787857010.002983:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c7926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89af8fbc-7ed9-4ab1-8779-5ad6bfebb681:3624:1874703436441856:0@lo:400:kworker.0 00000100:00100000:2.0:1787857010.005757:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857010.005783:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436443392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857010.006063:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874703436443264:12345-0@lo:400:kworker.0 Request processed in 3618us (4196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857010.006078:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787857010.006431:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857010.006488:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436443392 00010000:00080000:2.0:1787857010.006496:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9064c8cb03c0 x1874703436443264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857010.006498:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436443392 00000100:00100000:2.0:1787857010.006515:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874703436443264:0@lo:400:kworker.0 00000100:00100000:3.0:1787857010.006566:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857010.006574:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787857010.006580:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9066008d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436443392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857010.006588:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787857010.006618:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1787857010.006670:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9066008d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874703436443392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857010.006676:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857010.006955:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874703436443392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857010.386386:0:19512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857011.207651:0:20356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787857011.411719:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857011.537701:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857011.537737:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9065d9c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436443520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787857011.537848:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857011.537965:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436443520 00000100:00100000:2.0:1787857011.537976:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436443520 00000100:00100000:2.0:1787857011.538059:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787857011.538084:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436443520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787857011.538126:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787857011.538195:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874703436443520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857011.538203:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787857011.538322:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9065d9c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874703436443520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787857012.058503:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9066008d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436443648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787857012.058611:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857012.058684:0:17914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436443648 00000100:00100000:1.0:1787857012.058694:0:17914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436443648 00000100:00100000:1.0:1787857012.058778:0:17914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787857012.058790:0:17914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436443648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787857012.058846:0:17914:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787857012.058928:0:17914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1874703436443648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857012.058936:0:17914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787857012.059303:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9066008d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874703436443648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787857012.059455:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9064c8cb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436443776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787857012.059499:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857012.062284:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703436443776 00000100:00100000:1.0:1787857012.062303:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703436443776 00000100:00100000:1.0:1787857012.062381:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787857012.062393:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436443776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787857012.062448:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787857012.062565:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874703436443776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (3064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857012.062573:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787857012.062663:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9064c8cb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874703436443776:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787857012.115033:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787857012.434396:0:17163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857012.700635:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700697:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700729:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700759:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700776:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700795:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700812:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700833:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700857:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1787857012.700892:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426924800 00000100:00100000:1.0:1787857012.700905:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426924800 00000100:00100000:1.0:1787857012.700977:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426925312 00000100:00100000:1.0:1787857012.700980:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426925312 00000100:00100000:1.0:1787857012.700995:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426924672 00000100:00100000:1.0:1787857012.700998:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426924672 00000100:00100000:1.0:1787857012.701010:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426925184 00000100:00100000:1.0:1787857012.701013:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426925184 00000100:00100000:1.0:1787857012.701031:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1787857012.701136:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426924288 00000100:00100000:3.0:1787857012.701140:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426924288 00000100:00100000:3.0:1787857012.701175:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:3.0:1787857012.701203:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c1c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:2400:x1874703426924288:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787857012.701322:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c1c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90f35eb6-658b-49d5-8d30-9116022ee9f3+13:2400:x1874703426924288:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 122us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.701332:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:3.0:1787857012.701374:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426924544 00000100:00100000:3.0:1787857012.701377:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426924544 00000100:00100000:3.0:1787857012.701404:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426925056 00000100:00100000:3.0:1787857012.701407:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426925056 00000100:00100000:3.0:1787857012.701419:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426924416 00000100:00100000:3.0:1787857012.701421:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426924416 00000100:00100000:3.0:1787857012.701436:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703426924928 00000100:00100000:3.0:1787857012.701439:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703426924928 00000100:00100000:3.0:1787857012.701491:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:3.0:1787857012.701498:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9065d9e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2400:x1874703426924544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787857012.701529:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9065d9e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2400:x1874703426924544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 32us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.701536:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:3.0:1787857012.701548:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:3.0:1787857012.701553:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+5:2400:x1874703426925056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787857012.701573:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+5:2400:x1874703426925056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 20us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.701578:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:3.0:1787857012.701588:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:3.0:1787857012.701593:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c82403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+22:2400:x1874703426924416:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787857012.701618:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c82403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54732495-c2d9-4110-96c9-7cc6d03017e0+22:2400:x1874703426924416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.701633:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:3.0:1787857012.701644:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:3.0:1787857012.701650:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+6:2400:x1874703426924928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1787857012.701674:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956236f-01aa-4d39-8628-24f029cf1eae+6:2400:x1874703426924928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.701680:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00080000:3.0:1787857012.701701:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857012.701705:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787857012.701708:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857012.701710:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857012.702201:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c80cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2400:x1874703426924800:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857012.702268:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c80cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2400:x1874703426924800:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857012.702276:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:1.0:1787857012.702298:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1787857012.702305:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9064c8242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a956236f-01aa-4d39-8628-24f029cf1eae+5:2400:x1874703426925312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857012.702327:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9064c8242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a956236f-01aa-4d39-8628-24f029cf1eae+5:2400:x1874703426925312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857012.702345:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1787857012.702358:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:1.0:1787857012.702364:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2400:x1874703426924672:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857012.702391:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54732495-c2d9-4110-96c9-7cc6d03017e0+5:2400:x1874703426924672:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857012.702398:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:1.0:1787857012.702407:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1787857012.702413:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90660193de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a956236f-01aa-4d39-8628-24f029cf1eae+5:2400:x1874703426925184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1787857012.702433:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90660193de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a956236f-01aa-4d39-8628-24f029cf1eae+5:2400:x1874703426925184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 21us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857012.702439:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 Debug log: 43580 lines, 43580 kept, 0 dropped, 0 bad.